00000001:02000400:3.0F:1785787333.563632:0:2987:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg353-server.virtnet: executing set_hostid 00000001:02000400:3.0:1785787357.967635:0:3210:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg353-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1785787360.249390:0:3273:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 424 MB/s 00000001:01000000:0.0F:1785787360.499982:0:3273:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 426 MB/s 00000001:01000000:2.0F:1785787360.753491:0:3273:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2819 MB/s 00000020:02000000:0.0:1785787361.803480:0:3302:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.56_1_g3060c05 00000400:02000000:0.0:1785787363.196992:0:3317:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.153@tcp [8/256/0/180] 00008000:02000000:1.0F:1785787366.842217:0:3467:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1785787431.325448:0:5271:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg353-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1785787441.486607:0:5801:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1785787441.486612:0:5801:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1785787441.486732:0:5801:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000db7f4389 00000080:02000400:3.0:1785787441.486740:0:5801:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1785787441.493510:0:5801:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1785787441.493523:0:5801:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1785787441.495183:0:5801:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000aa9c4ee8) 00000020:00000080:2.0:1785787441.495203:0:5801:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1785787441.551972:0:5801:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1785787441.553459:0:5801:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1785787441.644302:0:5801:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1785787441.644340:0:5801:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1785787441.644359:0:5801:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1785787441.644404:0:5801:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1785787441.644427:0:5801:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1785787441.644722:0:5801:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1785787441.644730:0:5801:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1785787441.644738:0:5801:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe2c2ff68a6e8414b 00000020:01000004:1.0:1785787441.644744:0:5801:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1785787441.644749:0:5801:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1785787441.644753:0:5801:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000db7f4389 from MGS 00000020:01000004:1.0:1785787441.644757:0:5801:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1785787441.644780:0:5801:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000010afc464) 00000020:00000080:1.0:1785787441.644790:0:5801:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1785787441.644894:0:5801:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000db7f4389 from MGS, refs=2 00080000:01000000:1.0:1785787441.644899:0:5801:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1785787441.644905:0:5801:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe2c2ff68a6e84159 00000100:00100000:1.0:1785787441.646242:0:5801:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1785787441.646347:0:5801:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1785787441.646353:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1785787441.655211:0:5801:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1785787441.655221:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1785787441.657507:0:5801:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1785787441.657662:0:5801:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1785787441.657668:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1785787441.658331:0:5801:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1785787441.658337:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1785787441.659478:0:5801:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1785787441.659487:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1785787441.662050:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787441.662055:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787441.662056:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787441.664330:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787441.664334:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787441.664335:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787441.664774:0:5801:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1785787441.683917:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1785787441.913938:0:5801:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2779 MB/s 00000001:01000000:0.0:1785787442.164500:0:5801:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2743 MB/s 00000001:01000000:2.0:1785787442.414509:0:5801:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 500 MB/s 00000001:01000000:0.0:1785787442.663865:0:5801:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 699 MB/s 00080000:10000000:0.0:1785787442.674387:0:5801:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:2.0:1785787442.674906:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1785787442.691814:0:5801:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1785787442.692008:0:5801:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1785787442.692011:0:5801:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1785787442.692547:0:5811:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1785787442.692592:0:5801:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1785787442.692619:0:5801:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1785787442.692724:0:5801:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1785787442.692744:0:5801:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1785787442.693147:0:5801:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1785787442.693279:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1785787442.693285:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1785787442.695382:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1785787442.695391:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1785787442.696317:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1785787442.696323:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1785787442.696745:0:5801:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1785787442.696769:0:5801:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.153@tcp' 00000020:01000004:0.0:1785787442.696771:0:5801:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1785787442.696889:0:5801:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.153@tcp (typ=mgc) 00000020:00000080:0.0:1785787442.696905:0:5801:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.153@tcp (00000000195b350a) 00000020:00000080:0.0:1785787442.696919:0:5801:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00000100:00080000:2.0:1785787442.697456:0:5815:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00080000:0.0:1785787442.698071:0:5801:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002f7b377f@MGC192.168.203.153@tcp: add connection 192.168.203.153@tcp at head 00010000:00010000:0.0:1785787442.698224:0:5801:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.153@tcp-0 is initialized 00000040:01000000:0.0:1785787442.698230:0:5801:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.153@tcp ctxt 1 is initialized 10000000:01000000:0.0:1785787442.723556:0:5818:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1785787442.723761:0:5801:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.153@tcp (uuid d8642023-9103-4dbf-85d1-f204189bc871) 00000020:00000080:1.0:1785787442.723782:0:5801:0:(genops.c:1406:class_connect()) connect: client d8642023-9103-4dbf-85d1-f204189bc871, cookie 0xe2c2ff68a6e84167 00000100:00080000:1.0:1785787442.723803:0:5801:0:(import.c:510:import_select_connection()) MGC192.168.203.153@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1785787442.723809:0:5801:0:(import.c:624:import_select_connection()) MGC192.168.203.153@tcp: import 000000002f7b377f using connection 192.168.203.153@tcp/0@lo 00000100:00100000:1.0:1785787442.723866:0:5801:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002c0cdd7d x1872533769945216/t0(0) o250->MGC192.168.203.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1785787442.723890:0:5801:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import d8642023-9103-4dbf-85d1-f204189bc871->MGS 00000020:01000004:1.0:1785787442.723907:0:5801:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1785787442.723911:0:5801:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1785787442.723922:0:5801:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000a360a437) 00000020:00000080:1.0:1785787442.723935:0:5801:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1785787442.724086:0:3332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002c0cdd7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d8642023-9103-4dbf-85d1-f204189bc871:3332:1872533769945216:0@lo:250: 00000100:00100000:1.0:1785787442.724186:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787442.724379:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769945216 00000100:00100000:1.0:1785787442.724385:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769945216 00000100:00100000:1.0:1785787442.724411:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1785787442.724426:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000deecc6d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3332:x1872533769945216:12345-0@lo:250: 00010000:00080000:1.0:1785787442.724444:0:5812:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from d8642023-9103-4dbf-85d1-f204189bc871@0@lo t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:1.0:1785787442.724462:0:5812:0:(genops.c:1406:class_connect()) connect: client d8642023-9103-4dbf-85d1-f204189bc871, cookie 0xe2c2ff68a6e84175 00000100:00080000:1.0:1785787442.724564:0:5812:0:(import.c:65:import_set_state_nolock()) 00000000055cf871 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1785787442.724709:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000deecc6d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+5:3332:x1872533769945216:12345-0@lo:250: Request processed in 282us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787442.724716:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1785787442.724756:0:3332:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.153@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1785787442.724763:0:3332:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.153@tcp: connect to target with instance 0 00000100:00080000:1.0:1785787442.724769:0:3332:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.153@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1785787442.724772:0:3332:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1785787442.724775:0:3332:0:(import.c:65:import_set_state_nolock()) 000000002f7b377f MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1785787442.724777:0:3332:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1785787442.724784:0:3332:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1785787442.724788:0:3332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002c0cdd7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d8642023-9103-4dbf-85d1-f204189bc871:3332:1872533769945216:0@lo:250: 00000100:00100000:2.0:1785787442.757298:0:5801:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1785787442.757486:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1785787442.757492:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1785787442.766867:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1785787442.766884:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1785787442.767149:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1785787442.767158:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1785787442.767704:0:5801:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1785787442.767926:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1785787442.767937:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1785787442.768399:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1785787442.768416:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1785787442.845932:0:5801:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1785787442.847373:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1785787442.847382:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1785787442.848967:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1785787442.848975:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1785787442.851076:0:5801:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1785787442.851484:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1785787442.851491:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1785787442.852297:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1785787442.852304:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1785787442.854681:0:5801:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1785787442.854864:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1785787442.854874:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1785787442.860099:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1785787442.860115:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1785787442.861015:0:5801:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1785787442.861223:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1785787442.861228:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1785787442.861625:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1785787442.861631:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1785787442.917469:0:5801:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1785787442.917654:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1785787442.917659:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1785787442.922482:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1785787442.922494:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1785787442.938597:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1785787442.938609:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1785787442.939641:0:5801:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1785787442.939661:0:5801:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1785787442.939667:0:5801:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.153@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1785787442.939806:0:5801:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.153@tcp ctxt 0 is initialized 00000020:01000004:3.0:1785787442.939868:0:5801:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.153@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1785787442.939873:0:5801:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1785787442.939874:0:5801:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1785787442.939875:0:5801:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1785787442.939876:0:5801:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1785787442.939877:0:5801:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1785787442.939878:0:5801:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1785787442.939880:0:5801:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1785787442.939881:0:5801:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1785787442.939882:0:5801:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1785787442.939883:0:5801:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1785787442.939885:0:5801:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1785787442.939886:0:5801:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1785787442.939888:0:5801:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1785787442.939890:0:5801:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1785787442.939891:0:5801:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1785787442.939892:0:5801:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1785787442.939893:0:5801:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1785787442.939894:0:5801:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1785787442.939895:0:5801:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1785787442.939896:0:5801:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1785787442.939897:0:5801:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1785787442.939898:0:5801:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1785787442.939899:0:5801:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1785787442.939900:0:5801:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1785787442.939901:0:5801:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1785787442.939936:0:5801:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1785787442.939951:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d9ee1d4a pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:5801:1872533769945344:0@lo:253: 00000100:00100000:3.0:1785787442.940026:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787442.940078:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ab447b10 going to sleep for 11 seconds 00000100:00100000:2.0:1785787442.940140:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769945344 00000100:00100000:2.0:1785787442.940146:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769945344 00000100:00100000:2.0:1785787442.940190:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1785787442.940197:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6231787 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+5:5801:x1872533769945344:12345-0@lo:253: 20000000:01000000:2.0:1785787442.940244:0:5814:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1785787442.940247:0:5814:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1785787442.943026:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1785787442.943081:0:5814:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1785787442.943590:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1785787442.957703:0:5837:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1785787442.962471:0:5814:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1785787442.962478:0:5814:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1785787442.962484:0:5814:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1785787442.962487:0:5814:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1785787442.962508:0:5814:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1785787442.963359:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1785787442.964355:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1785787442.964371:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1785787442.965492:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1785787442.965557:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1785787442.965599:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1785787442.966481:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1785787442.966492:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1785787442.966545:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1785787442.966553:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1785787442.966585:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1785787442.966592:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1785787442.967001:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1785787442.967057:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1785787442.967092:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1785787442.967467:0:5814:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1785787442.967492:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1785787442.968075:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1785787442.968087:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1785787442.968509:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1785787442.968540:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1785787442.968587:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1785787442.968600:0:5814:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1785787442.969065:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1785787442.969076:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1785787442.969501:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1785787442.969545:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1785787442.969582:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1785787442.969593:0:5814:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1785787442.970091:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1785787442.970475:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1785787442.970515:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1785787442.970552:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1785787442.971093:0:5814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1785787442.971710:0:5814:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1785787442.971718:0:5814:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1785787442.981734:0:5838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1785787442.994693:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1785787442.994728:0:5814:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.153@tcp for mdt 20000000:01000000:3.0:1785787442.994730:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.153@tcp (null) (null) (null) 00000040:00080000:3.0:1785787442.995298:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1785787442.995308:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1785787442.995346:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1785787442.995354:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.153@tcp (null) (null) 00000040:00080000:3.0:1785787442.995404:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1785787442.995660:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1785787442.995699:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1785787442.995730:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1785787442.996306:0:5814:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1785787442.996310:0:5814:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1785787442.996316:0:5814:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1785787442.996322:0:5814:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1785787443.005322:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:0.0:1785787443.005562:0:5814:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1785787443.029648:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1785787443.029702:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:2.0:1785787443.029767:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:2.0:1785787443.029784:0:5814:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1785787443.029787:0:5814:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1785787443.029790:0:5814:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1785787443.029949:0:5814:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1785787443.029952:0:5814:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1785787443.029982:0:5814:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1785787443.029985:0:5814:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1785787443.030859:0:5840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1785787443.031143:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1785787443.031200:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1785787443.031242:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1785787443.031254:0:5814:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1785787443.031256:0:5814:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1785787443.031982:0:5841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:2.0:1785787443.032351:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:2.0:1785787443.032406:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:2.0:1785787443.032910:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:2.0:1785787443.032925:0:5814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1785787443.032927:0:5814:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:2.0:1785787443.032932:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1785787443.032951:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005357c164/0xe2c2ff68a6e8417c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787443.032965:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005357c164/0xe2c2ff68a6e8417c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787443.032975:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005357c164/0xe2c2ff68a6e8417c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787443.032981:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005357c164/0xe2c2ff68a6e8417c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787443.032987:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005357c164/0xe2c2ff68a6e8417c lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787443.032994:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005357c164/0xe2c2ff68a6e8417c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787443.032999:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005357c164 already unused, calling callback (0000000032dfb7a3) 00010000:00010000:2.0:1785787443.033002:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005357c164/0xe2c2ff68a6e8417c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787443.033009:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005357c164/0xe2c2ff68a6e8417c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787443.033020:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005357c164/0xe2c2ff68a6e8417c lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787443.033035:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005357c164/0xe2c2ff68a6e8417c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787443.033041:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005357c164/0xe2c2ff68a6e8417c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1785787443.033056:0:5814:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1785787443.509717:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6231787 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+5:5801:x1872533769945344:12345-0@lo:253: Request processed in 569513us (569685us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787443.509735:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1785787443.512963:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d9ee1d4a pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:5801:1872533769945344:0@lo:253: 10000000:01000000:1.0:1785787443.512980:0:5801:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1785787443.512983:0:5801:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1785787443.512984:0:5801:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1785787443.512986:0:5801:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785787443.512987:0:5801:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1785787443.512988:0:5801:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785787443.512989:0:5801:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785787443.512990:0:5801:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1785787443.512991:0:5801:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1785787443.512993:0:5801:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1785787443.512994:0:5801:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785787443.512995:0:5801:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1785787443.514983:0:5801:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000db7f4389 from lustre-MDT0000 10000000:01000000:0.0:1785787443.515013:0:5801:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1785787443.515016:0:5801:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1785787443.515020:0:5801:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9190515cb380 10000000:01000000:0.0:1785787443.515075:0:5801:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1785787443.515085:0:5801:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9190515cb380 from 1 10000000:01000000:0.0:1785787443.515088:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1785787443.515141:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: 000000008f9a52e7/0xe2c2ff68a6e84183 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787443.515152:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: 000000008f9a52e7/0xe2c2ff68a6e84183 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787443.515170:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: 000000008f9a52e7/0xe2c2ff68a6e84183 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787443.515188:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000649435c pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:5801:1872533769945472:0@lo:101: 00000100:00100000:0.0:1785787443.515241:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787443.516149:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set 000000004852a964 going to sleep for 11 seconds 00000100:00100000:1.0:1785787443.518174:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769945472 00000100:00100000:1.0:1785787443.518182:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769945472 00000100:00100000:1.0:1785787443.518266:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1785787443.518275:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000560d7d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+5:5801:x1872533769945472:12345-0@lo:101: 00010000:00010000:1.0:1785787443.518290:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787443.518314:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000260544e0/0xe2c2ff68a6e8418a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e84183 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787443.518335:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000260544e0/0xe2c2ff68a6e8418a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e84183 expref: 6 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787443.518344:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000260544e0/0xe2c2ff68a6e8418a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e84183 expref: 6 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787443.518353:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000260544e0, rc 0) 00000100:00100000:1.0:1785787443.518405:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000560d7d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+6:5801:x1872533769945472:12345-0@lo:101: Request processed in 132us (3164us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787443.518424:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1785787443.518500:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000649435c pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:5801:1872533769945472:0@lo:101: 00010000:00010000:3.0:1785787443.518514:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: 000000008f9a52e7/0xe2c2ff68a6e84183 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e8418a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787443.518521:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: 000000008f9a52e7/0xe2c2ff68a6e84183 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e8418a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787443.518573:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d67042b1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:5801:1872533769945600:0@lo:501: 00000100:00100000:3.0:1785787443.518615:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787443.525994:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set 000000009b8a308b going to sleep for 11 seconds 00000100:00100000:0.0:1785787443.526806:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769945600 00000100:00100000:0.0:1785787443.526816:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769945600 00000100:00100000:1.0:1785787443.526921:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1785787443.526931:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c883dfe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+6:5801:x1872533769945600:12345-0@lo:501: 00000100:00100000:1.0:1785787443.527193:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c883dfe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+6:5801:x1872533769945600:12345-0@lo:501: Request processed in 265us (8578us total) trans 0 rc -2/-2 00000100:00100000:1.0:1785787443.527201:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1785787443.527285:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d67042b1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:5801:1872533769945600:0@lo:501: 10000000:01000000:3.0:1785787443.527892:0:5801:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1785787443.527906:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: 000000008f9a52e7/0xe2c2ff68a6e84183 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e8418a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787443.527915:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: 000000008f9a52e7/0xe2c2ff68a6e84183 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e8418a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785787443.527924:0:5801:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff919056a98000 10000000:01000000:3.0:1785787443.527929:0:5801:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1785787443.527933:0:5801:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff919056a98000 10000000:01000000:3.0:1785787443.527936:0:5801:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1785787443.527939:0:5801:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff919056a98000 from 1 10000000:01000000:3.0:1785787443.527941:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1785787443.527971:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: 0000000047288d22/0xe2c2ff68a6e84191 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787443.527978:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: 0000000047288d22/0xe2c2ff68a6e84191 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787443.527985:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: 0000000047288d22/0xe2c2ff68a6e84191 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787443.528002:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d67042b1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:5801:1872533769945728:0@lo:101: 00000100:00100000:3.0:1785787443.528045:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787443.532646:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set 000000009b8a308b going to sleep for 11 seconds 00000100:00100000:2.0:1785787443.536238:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769945728 00000100:00100000:2.0:1785787443.536251:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769945728 00000100:00100000:3.0:1785787443.536421:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1785787443.536430:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000099703d79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+6:5801:x1872533769945728:12345-0@lo:101: 00010000:00010000:3.0:1785787443.536446:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787443.536469:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003cbdc362/0xe2c2ff68a6e84198 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e84191 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787443.536492:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003cbdc362/0xe2c2ff68a6e84198 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e84191 expref: 7 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787443.536502:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003cbdc362/0xe2c2ff68a6e84198 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e84191 expref: 7 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787443.536509:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003cbdc362, rc 0) 00000100:00100000:3.0:1785787443.536579:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000099703d79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+7:5801:x1872533769945728:12345-0@lo:101: Request processed in 149us (8533us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787443.536585:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1785787443.537897:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d67042b1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:5801:1872533769945728:0@lo:101: 00010000:00010000:2.0:1785787443.537914:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: 0000000047288d22/0xe2c2ff68a6e84191 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84198 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787443.537923:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: 0000000047288d22/0xe2c2ff68a6e84191 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e84198 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785787443.537939:0:5801:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1785787443.537954:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: 0000000047288d22/0xe2c2ff68a6e84191 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84198 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787443.537961:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: 0000000047288d22/0xe2c2ff68a6e84191 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84198 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785787443.537968:0:5801:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1785787443.537973:0:5801:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1785787443.537979:0:5801:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff919056a98000 10000000:01000000:2.0:1785787443.537981:0:5801:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1785787443.537985:0:5801:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1785787443.537987:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1785787443.538127:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: 000000005357c164/0xe2c2ff68a6e8419f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787443.538134:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: 000000005357c164/0xe2c2ff68a6e8419f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787443.538141:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: 000000005357c164/0xe2c2ff68a6e8419f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787443.538167:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005676a925 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:5801:1872533769945856:0@lo:101: 00000100:00100000:2.0:1785787443.538202:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787443.538240:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a03d2ce3 going to sleep for 11 seconds 00000100:00100000:3.0:1785787443.538288:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769945856 00000100:00100000:3.0:1785787443.538293:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769945856 00000100:00100000:3.0:1785787443.538322:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1785787443.538327:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b72cf199 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+7:5801:x1872533769945856:12345-0@lo:101: 00010000:00010000:3.0:1785787443.538335:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787443.538342:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000017e2d4ef/0xe2c2ff68a6e841a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e8419f expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787443.538356:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000017e2d4ef/0xe2c2ff68a6e841a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e8419f expref: 8 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787443.538364:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000017e2d4ef/0xe2c2ff68a6e841a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e8419f expref: 8 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787443.538371:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000017e2d4ef, rc 0) 00000100:00100000:3.0:1785787443.538405:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b72cf199 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+8:5801:x1872533769945856:12345-0@lo:101: Request processed in 78us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787443.538421:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1785787443.538540:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005676a925 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:5801:1872533769945856:0@lo:101: 00010000:00010000:2.0:1785787443.538550:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: 000000005357c164/0xe2c2ff68a6e8419f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e841a6 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787443.538557:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: 000000005357c164/0xe2c2ff68a6e8419f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e841a6 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787443.538598:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005676a925 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:5801:1872533769945984:0@lo:501: 00000100:00100000:2.0:1785787443.538621:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787443.538641:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a03d2ce3 going to sleep for 11 seconds 00000100:00100000:3.0:1785787443.538685:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769945984 00000100:00100000:3.0:1785787443.538689:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769945984 00000100:00100000:3.0:1785787443.538704:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1785787443.538708:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5ccaafc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+8:5801:x1872533769945984:12345-0@lo:501: 00000100:00100000:3.0:1785787443.538935:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5ccaafc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+9:5801:x1872533769945984:12345-0@lo:501: Request processed in 226us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787443.538941:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1785787443.539052:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005676a925 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:5801:1872533769945984:0@lo:501: 00000100:00100000:2.0:1785787443.539075:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005676a925 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:5801:1872533769946112:0@lo:503: 00000100:00100000:2.0:1785787443.539106:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787443.539129:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a03d2ce3 going to sleep for 11 seconds 00000100:00100000:3.0:1785787443.539219:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769946112 00000100:00100000:3.0:1785787443.539223:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769946112 00000100:00100000:3.0:1785787443.539238:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1785787443.539242:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5fa8e05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+9:5801:x1872533769946112:12345-0@lo:503: 00000100:00100000:3.0:1785787443.539375:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5fa8e05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+9:5801:x1872533769946112:12345-0@lo:503: Request processed in 132us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787443.539381:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1785787443.539485:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005676a925 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:5801:1872533769946112:0@lo:503: 00000100:00100000:2.0:1785787443.540076:0:5844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005676a925 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:5844:1872533769946240:0@lo:502: 00000100:00100000:2.0:1785787443.540109:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787443.540132:0:5844:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f90ab5a0 going to sleep for 11 seconds 00000100:00100000:3.0:1785787443.540221:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769946240 00000100:00100000:3.0:1785787443.540225:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769946240 00000100:00100000:3.0:1785787443.540241:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1785787443.540246:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c1b617db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+9:5844:x1872533769946240:12345-0@lo:502: 00000100:00100000:3.0:1785787443.540379:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c1b617db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+9:5844:x1872533769946240:12345-0@lo:502: Request processed in 133us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787443.540386:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1785787443.540494:0:5844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005676a925 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:5844:1872533769946240:0@lo:502: 00000020:01000000:2.0:1785787443.540512:0:5844:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1785787443.540521:0:5844:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785787443.540523:0:5844:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1785787443.540528:0:5844:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1785787443.540530:0:5844:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1785787443.540541:0:5844:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000acd89d91) 00000020:00000080:2.0:1785787443.540556:0:5844:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1785787443.540561:0:5844:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1785787443.540612:0:5844:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:2.0:1785787443.540616:0:5844:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe2c2ff68a6e841b4 00000020:00000080:2.0:1785787443.540850:0:5844:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1785787443.540855:0:5844:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1785787443.540858:0:5844:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785787443.540859:0:5844:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1785787443.540861:0:5844:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1785787443.540864:0:5844:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785787443.540865:0:5844:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1785787443.540868:0:5844:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1785787443.540874:0:5844:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000005e1e514d) 00000020:00000080:2.0:1785787443.540883:0:5844:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1785787443.540886:0:5844:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1785787443.540887:0:5844:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1785787443.540890:0:5844:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1785787443.540894:0:5844:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1785787443.540930:0:5844:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000db7f4389 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1785787443.540939:0:5844:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000090693fdf) 00000020:00000080:2.0:1785787443.540945:0:5844:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1785787443.540992:0:5844:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1785787443.540999:0:5844:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe2c2ff68a6e841c9 00000020:00000080:2.0:1785787443.541202:0:5844:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1785787443.541208:0:5844:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1785787443.541212:0:5844:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xe2c2ff68a6e841d0 00080000:01000000:2.0:1785787443.541216:0:5844:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:2.0:1785787443.541218:0:5844:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe2c2ff68a6e841d7 00080000:10000000:2.0:1785787443.541558:0:5844:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1785787443.541709:0:5844:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1785787443.556713:0:5844:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1785787443.703880:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787443.804858:0:5844:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1785787443.807577:0:5844:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1785787443.813204:0:5844:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1785787443.815295:0:5844:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1785787443.892044:0:5844:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000000538a60d) 00000020:00000080:2.0:1785787443.892065:0:5844:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1785787443.892131:0:5844:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1785787443.892138:0:5844:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe2c2ff68a6e841e5 00000020:00000080:2.0:1785787443.894180:0:5844:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1785787443.897376:0:5844:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1785787444.003399:0:5844:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1785787444.066006:0:5844:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1785787444.174817:0:5844:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1785787444.241578:0:5844:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1785787444.291052:0:5844:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1785787444.358211:0:5844:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xe2c2ff68a6e841ec 00000020:00000080:1.0:1785787444.358656:0:5844:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1785787444.358666:0:5844:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1785787444.358672:0:5844:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785787444.358675:0:5844:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1785787444.358677:0:5844:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1785787444.358683:0:5844:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785787444.358684:0:5844:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1785787444.358689:0:5844:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1785787444.358718:0:5844:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1785787444.358729:0:5844:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1785787444.358732:0:5844:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785787444.358733:0:5844:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1785787444.358735:0:5844:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1785787444.358738:0:5844:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785787444.358739:0:5844:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:1.0:1785787444.358750:0:5844:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1785787444.358752:0:5844:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1785787444.358787:0:5844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002c0cdd7d pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:5844:1872533769946368:0@lo:502: 00000100:00100000:1.0:1785787444.358880:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787444.358930:0:5844:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b5e21cab going to sleep for 11 seconds 00000100:00100000:0.0:1785787444.361338:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769946368 00000100:00100000:0.0:1785787444.361349:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769946368 00000100:00100000:0.0:1785787444.361408:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1785787444.361416:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051d1584d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+9:5844:x1872533769946368:12345-0@lo:502: 00000100:00100000:0.0:1785787444.361747:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051d1584d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+9:5844:x1872533769946368:12345-0@lo:502: Request processed in 331us (2867us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787444.361755:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1785787444.361874:0:5844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002c0cdd7d pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:5844:1872533769946368:0@lo:502: 00000020:01000000:2.0:1785787444.361904:0:5844:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1785787444.361910:0:5844:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785787444.361911:0:5844:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:2.0:1785787444.361917:0:5844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1785787444.362054:0:5801:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1785787444.362075:0:5801:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1785787444.362095:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: 000000005357c164/0xe2c2ff68a6e8419f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e841a6 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787444.362105:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: 000000005357c164/0xe2c2ff68a6e8419f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e841a6 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785787444.362113:0:5801:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff919056a98000 from 1 10000000:01000000:0.0:1785787444.362116:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1785787444.362143:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: 000000007b41a409/0xe2c2ff68a6e841f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787444.362149:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: 000000007b41a409/0xe2c2ff68a6e841f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787444.362165:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: 000000007b41a409/0xe2c2ff68a6e841f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787444.362180:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000112eaedc pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:5801:1872533769946496:0@lo:101: 00000100:00100000:0.0:1785787444.362210:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787444.362233:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set 0000000020b8f931 going to sleep for 11 seconds 00000100:00100000:1.0:1785787444.362362:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769946496 00000100:00100000:1.0:1785787444.362367:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769946496 00000100:00100000:1.0:1785787444.362395:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1785787444.362401:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082b45f61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+9:5801:x1872533769946496:12345-0@lo:101: 00010000:00010000:1.0:1785787444.362409:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787444.362421:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d26b494f/0xe2c2ff68a6e841fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e841f3 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787444.362438:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d26b494f/0xe2c2ff68a6e841fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e841f3 expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787444.362447:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d26b494f/0xe2c2ff68a6e841fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e841f3 expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787444.362454:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d26b494f, rc 0) 00000100:00100000:1.0:1785787444.362487:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082b45f61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+10:5801:x1872533769946496:12345-0@lo:101: Request processed in 87us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787444.362493:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1785787444.362558:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000112eaedc pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:5801:1872533769946496:0@lo:101: 00010000:00010000:2.0:1785787444.362569:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: 000000007b41a409/0xe2c2ff68a6e841f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e841fa expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787444.362577:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: 000000007b41a409/0xe2c2ff68a6e841f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e841fa expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787444.363124:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005676a925 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:5801:1872533769946624:0@lo:256: 00000100:00100000:2.0:1785787444.363171:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787444.363187:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b0bfe1ca going to sleep for 11 seconds 00000100:00100000:1.0:1785787444.363284:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769946624 00000100:00100000:1.0:1785787444.363289:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769946624 00000100:00100000:1.0:1785787444.363315:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1785787444.363321:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000040ee2b5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+10:5801:x1872533769946624:12345-0@lo:256: 20000000:01000000:1.0:1785787444.363332:0:5812:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1785787444.363337:0:5812:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1785787444.363394:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000040ee2b5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+10:5801:x1872533769946624:12345-0@lo:256: Request processed in 73us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787444.363399:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1785787444.363466:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005676a925 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:5801:1872533769946624:0@lo:256: 10000000:01000000:2.0:1785787444.364007:0:5801:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1785787444.364071:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: 000000007b41a409/0xe2c2ff68a6e841f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e841fa expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787444.364079:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: 000000007b41a409/0xe2c2ff68a6e841f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e841fa expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785787444.364086:0:5801:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff919056a98000 from 1 10000000:01000000:2.0:1785787444.364088:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1785787444.364103:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: 000000000d628fdd/0xe2c2ff68a6e84201 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787444.364109:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: 000000000d628fdd/0xe2c2ff68a6e84201 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787444.364116:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: 000000000d628fdd/0xe2c2ff68a6e84201 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787444.364126:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005676a925 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:5801:1872533769946752:0@lo:101: 00000100:00100000:2.0:1785787444.364148:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787444.364176:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b0bfe1ca going to sleep for 11 seconds 00000100:00100000:1.0:1785787444.364221:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769946752 00000100:00100000:1.0:1785787444.364225:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769946752 00000100:00100000:1.0:1785787444.364252:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1785787444.364256:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000021edfd4f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+10:5801:x1872533769946752:12345-0@lo:101: 00010000:00010000:1.0:1785787444.364263:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787444.364271:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006fae39bd/0xe2c2ff68a6e84208 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e84201 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787444.364282:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006fae39bd/0xe2c2ff68a6e84208 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e84201 expref: 11 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787444.364289:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006fae39bd/0xe2c2ff68a6e84208 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e84201 expref: 11 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787444.364295:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006fae39bd, rc 0) 00000100:00100000:1.0:1785787444.364318:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000021edfd4f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+11:5801:x1872533769946752:12345-0@lo:101: Request processed in 62us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787444.364323:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1785787444.364471:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005676a925 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:5801:1872533769946752:0@lo:101: 00010000:00010000:2.0:1785787444.364481:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: 000000000d628fdd/0xe2c2ff68a6e84201 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84208 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787444.364487:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: 000000000d628fdd/0xe2c2ff68a6e84201 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e84208 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787444.364530:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005676a925 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:5801:1872533769946880:0@lo:501: 00000100:00100000:2.0:1785787444.364553:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787444.364573:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b0bfe1ca going to sleep for 11 seconds 00000100:00100000:1.0:1785787444.364616:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769946880 00000100:00100000:1.0:1785787444.364620:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769946880 00000100:00100000:1.0:1785787444.364646:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1785787444.364651:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb7bb7f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+11:5801:x1872533769946880:12345-0@lo:501: 00000100:00100000:1.0:1785787444.366303:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb7bb7f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+11:5801:x1872533769946880:12345-0@lo:501: Request processed in 1651us (1747us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787444.366310:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1785787444.366412:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005676a925 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:5801:1872533769946880:0@lo:501: 00000100:00100000:2.0:1785787444.366438:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005676a925 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:5801:1872533769947008:0@lo:503: 00000100:00100000:2.0:1785787444.366472:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787444.366497:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b0bfe1ca going to sleep for 11 seconds 00000100:00100000:1.0:1785787444.366543:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769947008 00000100:00100000:1.0:1785787444.366552:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769947008 00000100:00100000:1.0:1785787444.366571:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1785787444.366577:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041799946 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+11:5801:x1872533769947008:12345-0@lo:503: 00000040:00080000:1.0:1785787444.366606:0:5813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1785787444.366654:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041799946 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+11:5801:x1872533769947008:12345-0@lo:503: Request processed in 77us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787444.366660:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1785787444.366759:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005676a925 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:5801:1872533769947008:0@lo:503: 00000040:00080000:2.0:1785787444.367707:0:5848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1785787444.370993:0:5801:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1785787444.371025:0:5801:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1785787444.371067:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: 000000000d628fdd/0xe2c2ff68a6e84201 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84208 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787444.371080:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: 000000000d628fdd/0xe2c2ff68a6e84201 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84208 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785787444.373148:0:5801:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1785787444.373162:0:5801:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff919056a98000 10000000:01000000:1.0:1785787444.373165:0:5801:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff919056a98000 10000000:01000000:1.0:1785787444.373169:0:5801:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1785787444.373176:0:5801:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff919056a98000 from 1 10000000:01000000:1.0:1785787444.373179:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1785787444.373214:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: 00000000fa3b8c89/0xe2c2ff68a6e8420f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787444.373223:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: 00000000fa3b8c89/0xe2c2ff68a6e8420f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787444.373233:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: 00000000fa3b8c89/0xe2c2ff68a6e8420f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787444.373250:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000069df8b9f pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:5801:1872533769947136:0@lo:101: 00000100:00100000:1.0:1785787444.373305:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787444.373417:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set 000000007e39f6b7 going to sleep for 11 seconds 00000100:00100000:3.0:1785787444.375955:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769947136 00000100:00100000:3.0:1785787444.375963:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769947136 00000100:00100000:2.0:1785787444.378308:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1785787444.378317:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000004c792a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+11:5801:x1872533769947136:12345-0@lo:101: 00010000:00010000:2.0:1785787444.378334:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787444.378348:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000635f88c5/0xe2c2ff68a6e84216 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e8420f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787444.378373:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000635f88c5/0xe2c2ff68a6e84216 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e8420f expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787444.378382:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000635f88c5/0xe2c2ff68a6e84216 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e8420f expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787444.378389:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000635f88c5, rc 0) 00000100:00100000:2.0:1785787444.378455:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000004c792a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+12:5801:x1872533769947136:12345-0@lo:101: Request processed in 139us (5150us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787444.378461:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1785787444.378557:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000069df8b9f pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:5801:1872533769947136:0@lo:101: 00010000:00010000:3.0:1785787444.378571:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: 00000000fa3b8c89/0xe2c2ff68a6e8420f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84216 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787444.378587:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: 00000000fa3b8c89/0xe2c2ff68a6e8420f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e84216 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787444.378644:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008ec1c52d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:5801:1872533769947264:0@lo:501: 00000100:00100000:3.0:1785787444.378672:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787444.385590:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set 000000004ea31d58 going to sleep for 11 seconds 00000100:00100000:1.0:1785787444.388959:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769947264 00000100:00100000:1.0:1785787444.388972:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769947264 00000100:00100000:1.0:1785787444.389338:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1785787444.389346:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022723e4e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+12:5801:x1872533769947264:12345-0@lo:501: 00000100:00100000:1.0:1785787444.389626:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022723e4e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+12:5801:x1872533769947264:12345-0@lo:501: Request processed in 280us (10953us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787444.389639:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1785787444.389728:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008ec1c52d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:5801:1872533769947264:0@lo:501: 00000100:00100000:3.0:1785787444.389770:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008ec1c52d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:5801:1872533769947392:0@lo:503: 00000100:00100000:3.0:1785787444.389806:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787444.389854:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set 000000004ea31d58 going to sleep for 11 seconds 00000100:00100000:1.0:1785787444.389899:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769947392 00000100:00100000:1.0:1785787444.389903:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769947392 00000100:00100000:1.0:1785787444.389918:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1785787444.389922:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5e5a033 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+12:5801:x1872533769947392:12345-0@lo:503: 00000100:00100000:1.0:1785787444.390305:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5e5a033 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+12:5801:x1872533769947392:12345-0@lo:503: Request processed in 382us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787444.390312:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1785787444.390382:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008ec1c52d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:5801:1872533769947392:0@lo:503: 00000100:00100000:3.0:1785787444.397313:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008ec1c52d pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:5849:1872533769947520:0@lo:502: 00000100:00100000:3.0:1785787444.397382:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787444.397469:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set 000000004ea31d58 going to sleep for 11 seconds 00000100:00100000:1.0:1785787444.400007:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769947520 00000100:00100000:1.0:1785787444.400073:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769947520 00000100:00100000:1.0:1785787444.400168:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1785787444.400178:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002314240e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+12:5849:x1872533769947520:12345-0@lo:502: 00000100:00100000:1.0:1785787444.400451:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002314240e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+12:5849:x1872533769947520:12345-0@lo:502: Request processed in 275us (3069us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787444.400458:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1785787444.400548:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008ec1c52d pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:5849:1872533769947520:0@lo:502: 00000020:01000004:3.0:1785787444.400606:0:5849:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1785787444.400628:0:5849:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000006fb66c26) 00000020:00000080:3.0:1785787444.400645:0:5849:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1785787444.400823:0:5849:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000db7f4389 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1785787444.400847:0:5849:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000db7f4389 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1785787444.400850:0:5849:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000db7f4389 4 00010000:00080000:3.0:1785787444.400875:0:5849:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000e1ce78c6@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.153@tcp at head 00010000:00010000:3.0:1785787444.402350:0:5849:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1785787444.402419:0:5849:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1785787444.402441:0:5849:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1785787444.402454:0:5849:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xe2c2ff68a6e84224 00000100:00080000:3.0:1785787444.402461:0:5849:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1785787444.402465:0:5849:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000e1ce78c6 using connection 192.168.203.153@tcp/0@lo 00000100:00100000:3.0:1785787444.402491:0:5849:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008ec1c52d x1872533769947648/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785787444.402527:0:3332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008ec1c52d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3332:1872533769947648:0@lo:38: 00000100:00100000:3.0:1785787444.402568:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787444.402622:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769947648 00000100:00100000:3.0:1785787444.402627:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769947648 00000100:00100000:3.0:1785787444.402652:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1785787444.402658:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007e66e369 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1872533769947648:12345-0@lo:38: 00000100:00100000:3.0:1785787444.402696:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007e66e369 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1872533769947648:12345-0@lo:38: Request processed in 38us (128us total) trans 0 rc -11/-11 00000100:00100000:3.0:1785787444.402703:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1785787444.402727:0:3332:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1785787444.402732:0:3332:0:(import.c:65:import_set_state_nolock()) 00000000e1ce78c6 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1785787444.402743:0:3332:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1785787444.402746:0:3332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008ec1c52d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3332:1872533769947648:0@lo:38: 00000100:00080000:3.0:1785787444.402770:0:5849:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1785787444.406777:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000acf768f8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:5849:1872533769947776:0@lo:502: 00000100:00100000:0.0:1785787444.406858:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787444.411280:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769947776 00000100:00100000:2.0:1785787444.411293:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769947776 00000100:00100000:2.0:1785787444.411344:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1785787444.411351:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025fef038 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+12:5849:x1872533769947776:12345-0@lo:502: 00000100:00100000:2.0:1785787444.411587:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025fef038 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+12:5849:x1872533769947776:12345-0@lo:502: Request processed in 236us (4729us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787444.411595:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1785787444.414946:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set 00000000515f6e68 going to sleep for 11 seconds 00000100:00100000:2.0:1785787444.414979:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000acf768f8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:5849:1872533769947776:0@lo:502: 00000040:00080000:2.0:1785787444.415014:0:5849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1785787444.415220:0:5801:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1785787444.415237:0:5801:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1785787444.415312:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: 00000000fa3b8c89/0xe2c2ff68a6e8420f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84216 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787444.415322:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: 00000000fa3b8c89/0xe2c2ff68a6e8420f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84216 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1785787444.415364:0:5801:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1785787444.415369:0:5801:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1785787444.415370:0:5801:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1785787444.415371:0:5801:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1785787444.415372:0:5801:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1785787444.415373:0:5801:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1785787444.415374:0:5801:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1785787444.415375:0:5801:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1785787444.415377:0:5801:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1785787444.415378:0:5801:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1785787444.415379:0:5801:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1785787444.415380:0:5801:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1785787444.415383:0:5801:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1785787444.415385:0:5801:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1785787444.415386:0:5801:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1785787444.415387:0:5801:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1785787444.415387:0:5801:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1785787444.415388:0:5801:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1785787444.415389:0:5801:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1785787444.415390:0:5801:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1785787444.415391:0:5801:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1785787444.415391:0:5801:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1785787444.415392:0:5801:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1785787444.415393:0:5801:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1785787444.415394:0:5801:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1785787444.415412:0:5801:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1785787444.415423:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008ec1c52d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:5801:1872533769947904:0@lo:253: 00000100:00100000:3.0:1785787444.415469:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787444.415495:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d7e40c2d going to sleep for 11 seconds 00000100:00100000:1.0:1785787444.416101:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769947904 00000100:00100000:1.0:1785787444.416107:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769947904 00000100:00100000:1.0:1785787444.416143:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1785787444.416151:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb1fe740 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+12:5801:x1872533769947904:12345-0@lo:253: 20000000:01000000:1.0:1785787444.416183:0:5812:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1785787444.416194:0:5812:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1785787444.534476:0:5812:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1785787444.534498:0:5812:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1785787444.534552:0:5836:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1785787444.534557:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1785787444.534573:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005f6e5b66/0xe2c2ff68a6e8422b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787444.534588:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d26b494f/0xe2c2ff68a6e841fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e841f3 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787444.534609:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000005f6e5b66/0xe2c2ff68a6e8422b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787444.534643:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d26b494f/0xe2c2ff68a6e841fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2c2ff68a6e841f3 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787444.534654:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d26b494f/0xe2c2ff68a6e841fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2c2ff68a6e841f3 expref: 12 pid: 5812 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787444.534665:0:5836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000053070927 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5836:1872533769948032:0@lo:104: 00000100:00100000:1.0:1785787444.534716:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787444.534765:0:5836:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c5b21533 going to sleep for 11 seconds 00000100:00100000:3.0:1785787444.535201:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769948032 00000100:00100000:3.0:1785787444.535210:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769948032 00000100:00100000:3.0:1785787444.535259:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1785787444.535268:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bfbeb305 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8642023-9103-4dbf-85d1-f204189bc871+3:5836:x1872533769948032:12345-0@lo:104: 00010000:00010000:3.0:1785787444.535280:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: 000000007b41a409/0xe2c2ff68a6e841f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e841fa expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787444.535345:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1785787444.535350:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bfbeb305 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8642023-9103-4dbf-85d1-f204189bc871+3:5836:x1872533769948032:12345-0@lo:104: Request processed in 85us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787444.535357:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1785787444.535377:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785787444.535381:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: 000000007b41a409/0xe2c2ff68a6e841f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e841fa expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787444.535389:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007b41a409 already unused, calling callback (00000000b634450d) 10000000:00010000:3.0:1785787444.535391:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: 000000007b41a409/0xe2c2ff68a6e841f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2c2ff68a6e841fa expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787444.535399:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: 000000007b41a409/0xe2c2ff68a6e841f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2c2ff68a6e841fa expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785787444.535405:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: 000000007b41a409/0xe2c2ff68a6e841f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2c2ff68a6e841fa expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785787444.535410:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1785787444.535437:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: 000000007b41a409/0xe2c2ff68a6e841f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e841fa expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787444.535443:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785787444.535459:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: 000000007b41a409/0xe2c2ff68a6e841f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e841fa expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787444.535465:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: 000000007b41a409/0xe2c2ff68a6e841f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e841fa expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787444.535490:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787444.535492:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787444.535493:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787444.535540:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001dc934ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533769948160:0@lo:103: 00000100:00100000:3.0:1785787444.535569:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787444.535635:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769948160 00000100:00100000:3.0:1785787444.535640:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769948160 00010000:00010000:3.0:1785787444.535653:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d26b494f/0xe2c2ff68a6e841fa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e841f3 expref: 13 pid: 5812 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787444.535674:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1785787444.535680:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3083786 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8642023-9103-4dbf-85d1-f204189bc871+13:3334:x1872533769948160:12345-0@lo:103: 00010000:00010000:3.0:1785787444.535690:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787444.535695:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d26b494f/0xe2c2ff68a6e841fa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e841f3 expref: 13 pid: 5812 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787444.535703:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d26b494f/0xe2c2ff68a6e841fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2c2ff68a6e841f3 expref: 13 pid: 5812 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787444.535716:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000005f6e5b66/0xe2c2ff68a6e8422b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787444.535722:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005f6e5b66/0xe2c2ff68a6e8422b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1785787444.535733:0:5805:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001176686s 00010000:00010000:3.0:1785787444.535736:0:5805:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005f6e5b66/0xe2c2ff68a6e8422b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787444.535751:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005f6e5b66/0xe2c2ff68a6e8422b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787444.535756:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005f6e5b66/0xe2c2ff68a6e8422b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787444.535762:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005f6e5b66/0xe2c2ff68a6e8422b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787444.535766:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005f6e5b66 already unused, calling callback (0000000032dfb7a3) 00010000:00010000:3.0:1785787444.535769:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005f6e5b66/0xe2c2ff68a6e8422b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787444.535774:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005f6e5b66/0xe2c2ff68a6e8422b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787444.535782:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005f6e5b66/0xe2c2ff68a6e8422b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787444.535790:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787444.535816:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3083786 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8642023-9103-4dbf-85d1-f204189bc871+13:3334:x1872533769948160:12345-0@lo:103: Request processed in 137us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787444.535822:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1785787444.535887:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001dc934ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533769948160:0@lo:103: 00010000:00010000:3.0:1785787444.535915:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d26b494f/0xe2c2ff68a6e841fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2c2ff68a6e841f3 expref: 12 pid: 5812 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787444.535924:0:5836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000053070927 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5836:1872533769948032:0@lo:104: 00010000:00010000:3.0:1785787444.535933:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000005f6e5b66/0xe2c2ff68a6e8422b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787444.535945:0:5836:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000005f6e5b66/0xe2c2ff68a6e8422b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787444.535951:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005f6e5b66/0xe2c2ff68a6e8422b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787444.535955:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005f6e5b66/0xe2c2ff68a6e8422b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787444.544584:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb1fe740 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+11:5801:x1872533769947904:12345-0@lo:253: Request processed in 128428us (129109us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787444.544596:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1785787444.544956:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008ec1c52d pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:5801:1872533769947904:0@lo:253: 10000000:01000000:1.0:1785787444.544972:0:5801:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1785787444.544975:0:5801:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1785787444.544976:0:5801:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1785787444.544977:0:5801:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785787444.544979:0:5801:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1785787444.544980:0:5801:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785787444.544981:0:5801:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785787444.544982:0:5801:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1785787444.544984:0:5801:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1785787444.544985:0:5801:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1785787444.544987:0:5801:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1785787444.544989:0:5801:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785787444.544990:0:5801:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1785787444.545006:0:5801:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1785787444.553752:0:5801:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1785787444.555431:0:5801:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1785787444.555621:0:5801:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1785787444.555767:0:5801:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1785787444.557294:0:5801:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1785787444.557463:0:5801:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1785787444.561486:0:5801:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1785787444.561700:0:5801:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1785787444.561956:0:5801:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1785787444.563420:0:5801:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1785787444.563622:0:5801:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1785787444.563807:0:5801:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00010000:00010000:0.0:1785787444.737253:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:2.0:1785787444.774906:0:5801:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1785787444.886200:0:5801:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1785787444.886307:0:5854:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1785787444.886312:0:5854:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1785787444.886604:0:5855:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1785787444.910821:0:5801:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1785787444.912817:0:5801:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1785787444.914534:0:5801:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1785787444.914547:0:5801:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1785787444.914710:0:5801:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1785787444.915679:0:5801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1785787444.923394:0:5801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1785787444.923463:0:5801:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1785787444.923715:0:5801:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1785787444.923893:0:5801:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1785787444.932214:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1785787444.932886:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1785787444.933044:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1785787444.933195:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1785787444.933334:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1785787444.942626:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1785787444.942796:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1785787444.942952:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1785787444.943111:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1785787444.943242:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1785787444.943390:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1785787444.943526:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1785787444.943674:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1785787444.943805:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1785787444.943968:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1785787444.944085:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1785787444.944379:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1785787444.944524:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1785787444.944681:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1785787444.944803:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1785787444.944953:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1785787444.945072:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1785787444.953673:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1785787444.953864:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1785787444.954003:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1785787444.959011:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1785787444.960543:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1785787444.960716:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1785787444.962526:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1785787444.962690:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1785787444.962851:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1785787444.962975:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1785787444.967420:0:5801:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1785787444.994288:0:5855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1785787445.110570:0:5801:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1785787445.110616:0:5801:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb1fe01c7b988 00100000:10000000:0.0:1785787445.110623:0:5801:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1785787445.112167:0:5801:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1785787445.112181:0:5801:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.153@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1785787445.112194:0:5801:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1785787445.112217:0:5801:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1785787445.259304:0:5855:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1785787445.259781:0:5855:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:0.0:1785787445.259786:0:5855:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1785787445.747074:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787446.771336:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787447.802890:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787448.819009:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787449.779047:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:2.0:1785787449.779070:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1785787449.779075:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1785787449.779077:0:37:0:(import.c:65:import_set_state_nolock()) 00000000e1ce78c6 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1785787449.779088:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000e1ce78c6 using connection 192.168.203.153@tcp/0@lo 00000100:00100000:2.0:1785787449.779108:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006f2103b9 x1872533769948416/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785787449.779243:0:3332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006f2103b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3332:1872533769948416:0@lo:38: 00000100:00100000:3.0:1785787449.779306:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787449.779424:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769948416 00000100:00100000:2.0:1785787449.779431:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769948416 00000100:00100000:2.0:1785787449.779466:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1785787449.779472:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001dc934ce pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1872533769948416:12345-0@lo:38: 00010000:00080000:2.0:1785787449.779495:0:5822:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 237 last 0 00000020:00000080:2.0:1785787449.779765:0:5822:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xe2c2ff68a6e84232 00000004:00100000:2.0:1785787449.779811:0:5822:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1785787449.780003:0:5822:0:(import.c:65:import_set_state_nolock()) 000000007c126d54 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1785787449.780044:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001dc934ce pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3332:x1872533769948416:12345-0@lo:38: Request processed in 572us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787449.780051:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1785787449.780151:0:3332:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006f2103b9 x1872533769948416/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1785787459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1785787449.780166:0:3332:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1785787449.780179:0:3332:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1785787449.780182:0:3332:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1785787449.780184:0:3332:0:(import.c:65:import_set_state_nolock()) 00000000e1ce78c6 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1785787449.780189:0:3332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006f2103b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3332:1872533769948416:0@lo:38: 00000100:00100000:1.0:1785787449.793870:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005676a925 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8642023-9103-4dbf-85d1-f204189bc871:3336:1872533769948288:0@lo:400: 00000100:00100000:1.0:1785787449.793941:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787449.794052:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769948288 00000100:00100000:0.0:1785787449.794060:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769948288 00000100:00100000:0.0:1785787449.794108:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1785787449.794125:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000014e6830d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+11:3336:x1872533769948288:12345-0@lo:400: 00000100:00100000:0.0:1785787449.794172:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000014e6830d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+11:3336:x1872533769948288:12345-0@lo:400: Request processed in 58us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787449.794179:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1785787449.794400:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005676a925 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8642023-9103-4dbf-85d1-f204189bc871:3336:1872533769948288:0@lo:400: 00010000:00010000:2.0:1785787449.857955:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787450.868431:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1785787451.611557:0:6099:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg353-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1785787451.891142:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1785787452.345696:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1785787452.345704:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff919056a98000 from 3 10000000:01000000:2.0:1785787452.345718:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1785787452.345755:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: 00000000fc57ae70/0xe2c2ff68a6e84239 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787452.345767:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: 00000000fc57ae70/0xe2c2ff68a6e84239 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787452.345776:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: 00000000fc57ae70/0xe2c2ff68a6e84239 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787452.345797:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d9d7497b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769948544:0@lo:101: 00000100:00100000:2.0:1785787452.345884:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787452.345924:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set 00000000dbbf3daf going to sleep for 11 seconds 00000100:00100000:2.0:1785787452.345951:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769948544 00000100:00100000:2.0:1785787452.345957:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769948544 00000100:00100000:2.0:1785787452.346008:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1785787452.346016:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064968639 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+11:5818:x1872533769948544:12345-0@lo:101: 00010000:00010000:2.0:1785787452.346028:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787452.346040:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d9fa2ac1/0xe2c2ff68a6e84240 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e84239 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787452.346060:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d9fa2ac1/0xe2c2ff68a6e84240 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e84239 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787452.346069:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d9fa2ac1/0xe2c2ff68a6e84240 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e84239 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787452.346078:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d9fa2ac1, rc 0) 00000100:00100000:2.0:1785787452.346124:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064968639 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+12:5818:x1872533769948544:12345-0@lo:101: Request processed in 109us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787452.346131:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1785787452.346173:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d9d7497b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769948544:0@lo:101: 00010000:00010000:2.0:1785787452.346186:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: 00000000fc57ae70/0xe2c2ff68a6e84239 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84240 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787452.346193:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: 00000000fc57ae70/0xe2c2ff68a6e84239 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e84240 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787452.346235:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d9d7497b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769948672:0@lo:256: 00000100:00100000:2.0:1785787452.346264:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787452.346279:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set 00000000dbbf3daf going to sleep for 11 seconds 00000100:00100000:2.0:1785787452.346292:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769948672 00000100:00100000:2.0:1785787452.346301:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769948672 00000100:00100000:2.0:1785787452.346323:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1785787452.346328:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6bf0b07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+12:5818:x1872533769948672:12345-0@lo:256: 20000000:01000000:2.0:1785787452.346341:0:5813:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1785787452.346356:0:5813:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1785787452.346359:0:5813:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1785787452.346421:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6bf0b07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+12:5818:x1872533769948672:12345-0@lo:256: Request processed in 93us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787452.346427:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1785787452.346453:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d9d7497b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769948672:0@lo:256: 10000000:01000000:2.0:1785787452.346486:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1785787452.346490:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: 00000000fc57ae70/0xe2c2ff68a6e84239 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84240 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787452.346497:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: 00000000fc57ae70/0xe2c2ff68a6e84239 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84240 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787452.917660:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787453.942746:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785787454.898993:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d9d7497b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8642023-9103-4dbf-85d1-f204189bc871:3336:1872533769948800:0@lo:400: 00000100:00100000:2.0:1785787454.899059:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787454.899130:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769948800 00000100:00100000:2.0:1785787454.899137:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769948800 00000100:00100000:2.0:1785787454.899176:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1785787454.899195:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c03843a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+12:3336:x1872533769948800:12345-0@lo:400: 00000100:00100000:2.0:1785787454.899242:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c03843a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+12:3336:x1872533769948800:12345-0@lo:400: Request processed in 60us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787454.899249:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1785787454.899295:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d9d7497b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8642023-9103-4dbf-85d1-f204189bc871:3336:1872533769948800:0@lo:400: 00000100:00100000:3.0:1785787454.899428:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000028dc1bc2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1872533769948928:0@lo:400: 00000100:00100000:3.0:1785787454.899460:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787454.899722:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769948928 00000100:00100000:2.0:1785787454.899726:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769948928 00000100:00100000:2.0:1785787454.899760:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1785787454.899766:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bdeb3488 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1872533769948928:12345-0@lo:400: 00000100:00100000:2.0:1785787454.899802:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bdeb3488 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1872533769948928:12345-0@lo:400: Request processed in 37us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787454.899809:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1785787454.899919:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000028dc1bc2 x1872533769948928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787454.899931:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000028dc1bc2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1872533769948928:0@lo:400: 00010000:00010000:0.0:1785787454.966066:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787455.988265:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787457.014230:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1785787457.078280:0:6300:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdcd22d5e0 20000000:00000080:0.0:1785787457.078296:0:6300:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91907c917400 uarg=0000000000000000 20000000:01000000:0.0:1785787457.078327:0:6300:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1785787457.078333:0:6300:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1785787457.078338:0:6300:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1785787457.078531:0:6300:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1785787457.078546:0:6300:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1785787457.094319:0:6300:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1785787457.094548:0:6300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1785787457.094595:0:6300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1785787457.094634:0:6300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1785787457.094650:0:6300:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1785787457.094664:0:6300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006e2a4731/0xe2c2ff68a6e84247 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787457.094681:0:6300:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006fae39bd/0xe2c2ff68a6e84208 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e84201 expref: 11 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787457.094688:0:6300:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006e2a4731/0xe2c2ff68a6e84247 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787457.094720:0:6300:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006fae39bd/0xe2c2ff68a6e84208 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2c2ff68a6e84201 expref: 11 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787457.094732:0:6300:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006fae39bd/0xe2c2ff68a6e84208 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2c2ff68a6e84201 expref: 11 pid: 5812 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787457.094756:0:6300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f943075f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6300:1872533769949056:0@lo:104: 00000100:00100000:3.0:1785787457.094810:0:6300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787457.094886:0:6300:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e46bea7d going to sleep for 11 seconds 00000100:00100000:1.0:1785787457.095033:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769949056 00000100:00100000:1.0:1785787457.095041:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769949056 00000100:00100000:1.0:1785787457.095092:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1785787457.095099:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059b99ca5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8642023-9103-4dbf-85d1-f204189bc871+3:6300:x1872533769949056:12345-0@lo:104: 00010000:00010000:1.0:1785787457.095110:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: 000000000d628fdd/0xe2c2ff68a6e84201 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e84208 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787457.095160:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1785787457.095165:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059b99ca5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8642023-9103-4dbf-85d1-f204189bc871+3:6300:x1872533769949056:12345-0@lo:104: Request processed in 68us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787457.095177:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1785787457.095230:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785787457.095235:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: 000000000d628fdd/0xe2c2ff68a6e84201 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e84208 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787457.095242:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000d628fdd already unused, calling callback (00000000b634450d) 10000000:00010000:2.0:1785787457.095245:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: 000000000d628fdd/0xe2c2ff68a6e84201 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2c2ff68a6e84208 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787457.095253:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: 000000000d628fdd/0xe2c2ff68a6e84201 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2c2ff68a6e84208 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785787457.095259:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: 000000000d628fdd/0xe2c2ff68a6e84201 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2c2ff68a6e84208 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785787457.095263:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1785787457.095294:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: 000000000d628fdd/0xe2c2ff68a6e84201 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e84208 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787457.095300:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785787457.095314:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: 000000000d628fdd/0xe2c2ff68a6e84201 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e84208 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787457.095320:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: 000000000d628fdd/0xe2c2ff68a6e84201 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e84208 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787457.095339:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787457.095341:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787457.095342:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785787457.095352:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d9d7497b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533769949184:0@lo:103: 00000100:00100000:2.0:1785787457.095378:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787457.095411:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769949184 00000100:00100000:2.0:1785787457.095414:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769949184 00010000:00010000:2.0:1785787457.095429:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006fae39bd/0xe2c2ff68a6e84208 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e84201 expref: 12 pid: 5812 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787457.095447:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1785787457.095452:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068874bfb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8642023-9103-4dbf-85d1-f204189bc871+12:3334:x1872533769949184:12345-0@lo:103: 00010000:00010000:2.0:1785787457.095460:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785787457.095463:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006fae39bd/0xe2c2ff68a6e84208 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e84201 expref: 12 pid: 5812 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787457.095471:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006fae39bd/0xe2c2ff68a6e84208 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2c2ff68a6e84201 expref: 12 pid: 5812 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787457.095484:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006e2a4731/0xe2c2ff68a6e84247 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787457.095490:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006e2a4731/0xe2c2ff68a6e84247 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787457.095500:0:5805:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006e2a4731/0xe2c2ff68a6e84247 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787457.095505:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006e2a4731/0xe2c2ff68a6e84247 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787457.095516:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006e2a4731/0xe2c2ff68a6e84247 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787457.095521:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006e2a4731/0xe2c2ff68a6e84247 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787457.095525:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006e2a4731 already unused, calling callback (0000000032dfb7a3) 00010000:00010000:2.0:1785787457.095528:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006e2a4731/0xe2c2ff68a6e84247 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787457.095534:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006e2a4731/0xe2c2ff68a6e84247 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787457.095541:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006e2a4731/0xe2c2ff68a6e84247 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787457.095549:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785787457.095571:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068874bfb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8642023-9103-4dbf-85d1-f204189bc871+12:3334:x1872533769949184:12345-0@lo:103: Request processed in 120us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787457.095578:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1785787457.095606:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d9d7497b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533769949184:0@lo:103: 00010000:00010000:3.0:1785787457.095717:0:6300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006fae39bd/0xe2c2ff68a6e84208 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2c2ff68a6e84201 expref: 11 pid: 5812 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787457.095727:0:6300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f943075f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6300:1872533769949056:0@lo:104: 00010000:00010000:3.0:1785787457.095736:0:6300:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006e2a4731/0xe2c2ff68a6e84247 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787457.095743:0:6300:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006e2a4731/0xe2c2ff68a6e84247 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787457.095748:0:6300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006e2a4731/0xe2c2ff68a6e84247 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787457.095752:0:6300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006e2a4731/0xe2c2ff68a6e84247 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787458.036879:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787459.058978:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787460.024462:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785787460.024485:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f943075f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8642023-9103-4dbf-85d1-f204189bc871:3336:1872533769949312:0@lo:400: 00000100:00100000:3.0:1785787460.024548:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787460.024602:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769949312 00000100:00100000:3.0:1785787460.024609:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769949312 00000100:00100000:3.0:1785787460.024648:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1785787460.024654:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033c45c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+11:3336:x1872533769949312:12345-0@lo:400: 00000100:00100000:3.0:1785787460.024697:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033c45c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+11:3336:x1872533769949312:12345-0@lo:400: Request processed in 43us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787460.024718:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1785787460.024761:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f943075f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8642023-9103-4dbf-85d1-f204189bc871:3336:1872533769949312:0@lo:400: 00000100:00100000:3.0:1785787460.024791:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f943075f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3336:1872533769949440:0@lo:400: 00000100:00100000:3.0:1785787460.024815:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787460.024860:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769949440 00000100:00100000:3.0:1785787460.024864:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769949440 00000100:00100000:3.0:1785787460.024886:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1785787460.024890:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d31cf9c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3336:x1872533769949440:12345-0@lo:400: 00000100:00100000:3.0:1785787460.024921:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d31cf9c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3336:x1872533769949440:12345-0@lo:400: Request processed in 30us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787460.024927:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1785787460.024951:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f943075f x1872533769949440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787460.024962:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f943075f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3336:1872533769949440:0@lo:400: 00010000:00010000:0.0:1785787460.092762:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787461.110991:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1785787461.111275:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1785787461.111279:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff919056a98000 from 1 10000000:01000000:2.0:1785787461.111282:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1785787461.111320:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: 00000000c1323ba5/0xe2c2ff68a6e8424e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787461.111331:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: 00000000c1323ba5/0xe2c2ff68a6e8424e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787461.111353:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: 00000000c1323ba5/0xe2c2ff68a6e8424e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787461.111381:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d9d7497b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769949568:0@lo:101: 00000100:00100000:2.0:1785787461.111438:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787461.111479:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set 00000000515f6e68 going to sleep for 11 seconds 00000100:00100000:3.0:1785787461.111545:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769949568 00000100:00100000:3.0:1785787461.111552:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769949568 00000100:00100000:3.0:1785787461.111591:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1785787461.111597:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e4d192ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+11:5818:x1872533769949568:12345-0@lo:101: 00010000:00010000:3.0:1785787461.111608:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787461.111619:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006e2a4731/0xe2c2ff68a6e84255 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e8424e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787461.111638:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006e2a4731/0xe2c2ff68a6e84255 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e8424e expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787461.111645:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006e2a4731/0xe2c2ff68a6e84255 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e8424e expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787461.111659:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006e2a4731, rc 0) 00000100:00100000:3.0:1785787461.111694:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e4d192ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+12:5818:x1872533769949568:12345-0@lo:101: Request processed in 97us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787461.111699:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1785787461.111987:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d9d7497b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769949568:0@lo:101: 00010000:00010000:2.0:1785787461.112000:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: 00000000c1323ba5/0xe2c2ff68a6e8424e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84255 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787461.112008:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: 00000000c1323ba5/0xe2c2ff68a6e8424e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e84255 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787461.112065:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d9d7497b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769949696:0@lo:501: 00000100:00100000:2.0:1785787461.112089:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787461.112115:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set 00000000515f6e68 going to sleep for 11 seconds 00000100:00100000:3.0:1785787461.112211:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769949696 00000100:00100000:3.0:1785787461.112215:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769949696 00000100:00100000:3.0:1785787461.112244:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1785787461.112250:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b9cbe70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+12:5818:x1872533769949696:12345-0@lo:501: 00000100:00100000:3.0:1785787461.112465:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b9cbe70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+12:5818:x1872533769949696:12345-0@lo:501: Request processed in 215us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787461.112472:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1785787461.113870:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d9d7497b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769949696:0@lo:501: 00000100:00100000:2.0:1785787461.113912:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d9d7497b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769949824:0@lo:503: 00000100:00100000:2.0:1785787461.113955:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787461.113981:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set 00000000515f6e68 going to sleep for 11 seconds 00000100:00100000:3.0:1785787461.114114:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769949824 00000100:00100000:3.0:1785787461.114119:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769949824 00000100:00100000:3.0:1785787461.114151:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1785787461.114158:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023ccf0c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+12:5818:x1872533769949824:12345-0@lo:503: 00000100:00100000:3.0:1785787461.114303:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023ccf0c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+12:5818:x1872533769949824:12345-0@lo:503: Request processed in 146us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787461.114310:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1785787461.114346:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d9d7497b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769949824:0@lo:503: 00000100:00100000:2.0:1785787461.116283:0:6492:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000047774820 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:6492:1872533769949952:0@lo:502: 00000100:00100000:2.0:1785787461.116329:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787461.116361:0:6492:0:(client.c:2702:ptlrpc_set_wait()) set 000000002b40cd2d going to sleep for 11 seconds 00000100:00100000:3.0:1785787461.116443:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769949952 00000100:00100000:3.0:1785787461.116448:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769949952 00000100:00100000:3.0:1785787461.116481:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1785787461.116487:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000681c0955 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+12:6492:x1872533769949952:12345-0@lo:502: 00000100:00100000:3.0:1785787461.116625:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000681c0955 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+12:6492:x1872533769949952:12345-0@lo:502: Request processed in 138us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787461.116641:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1785787461.116676:0:6492:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000047774820 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:6492:1872533769949952:0@lo:502: 00000020:01000000:3.0:1785787461.116698:0:6492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1785787461.116706:0:6492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785787461.116708:0:6492:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1785787461.116713:0:6492:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff919056a98000 00000020:00000080:3.0:1785787461.116715:0:6492:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1785787461.116745:0:6492:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b375180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:6492:1872533769950080:0@lo:502: 00000100:00100000:3.0:1785787461.116774:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787461.116792:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769950080 00000100:00100000:3.0:1785787461.116795:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769950080 00000100:00100000:3.0:1785787461.116813:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1785787461.116818:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+12:6492:x1872533769950080:12345-0@lo:502: 00000100:00100000:3.0:1785787461.116942:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+12:6492:x1872533769950080:12345-0@lo:502: Request processed in 123us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787461.116949:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1785787461.116972:0:6492:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190515b7480 going to sleep for 11 seconds 00000100:00100000:3.0:1785787461.116983:0:6492:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b375180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:6492:1872533769950080:0@lo:502: 00000020:01000000:3.0:1785787461.116998:0:6492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785787461.117001:0:6492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785787461.117003:0:6492:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1785787461.117006:0:6492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1785787461.117060:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1785787461.117074:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1785787461.117082:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff9190413a1c00/0xe2c2ff68a6e8424e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84255 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787461.117103:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff9190413a1c00/0xe2c2ff68a6e8424e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84255 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787462.135911:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787463.154998:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787464.180980:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1785787464.574888:0:6613:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1785787464.574891:0:6613:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1785787464.575038:0:6613:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff919048214000 00000020:01000004:3.0:1785787464.575054:0:6613:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1785787464.575065:0:6613:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1785787464.575163:0:6613:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9190507f4d40) 00000020:00000080:3.0:1785787464.575180:0:6613:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1785787464.615180:0:6613:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1785787464.619791:0:6613:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1785787464.659159:0:6613:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1785787464.669318:0:6613:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1785787464.669353:0:6613:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1785787464.669433:0:6613:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1785787464.671680:0:6613:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1785787464.673349:0:6613:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1785787464.673360:0:6613:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1785787464.673371:0:6613:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe2c2ff68a6e84263 00000020:01000004:2.0:1785787464.673379:0:6613:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1785787464.673398:0:6613:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.153@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1785787464.673401:0:6613:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1785787464.673407:0:6613:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1785787464.673411:0:6613:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1785787464.673422:0:6613:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff91905c490000) 00000020:00000080:2.0:1785787464.673431:0:6613:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1785787464.678435:0:6613:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1785787464.679989:0:6613:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1785787464.679996:0:6613:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1785787464.684693:0:6613:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1785787464.684703:0:6613:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1785787464.685657:0:6613:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1785787464.685664:0:6613:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1785787464.688083:0:6613:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1785787464.688231:0:6613:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1785787464.688236:0:6613:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1785787464.689033:0:6613:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1785787464.689046:0:6613:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1785787464.737604:0:6613:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1785787464.738171:0:6613:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1785787464.738178:0:6613:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1785787464.740274:0:6613:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1785787464.740282:0:6613:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1785787464.741803:0:6613:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1785787464.741810:0:6613:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1785787464.745922:0:6613:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1785787464.746379:0:6613:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1785787464.746385:0:6613:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1785787464.747729:0:6613:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1785787464.747737:0:6613:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1785787464.824856:0:6613:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1785787464.826692:0:6613:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1785787464.826700:0:6613:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1785787464.835199:0:6613:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1785787464.835213:0:6613:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1785787464.837106:0:6613:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1785787464.837130:0:6613:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1785787464.837137:0:6613:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.153@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1785787464.890824:0:6613:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.153@tcp ctxt 0 is initialized 00000020:01000004:1.0:1785787464.890875:0:6613:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.153@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1785787464.890879:0:6613:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1785787464.890880:0:6613:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1785787464.890882:0:6613:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785787464.890883:0:6613:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1785787464.890884:0:6613:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785787464.890885:0:6613:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785787464.890886:0:6613:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1785787464.890888:0:6613:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1785787464.890889:0:6613:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1785787464.890890:0:6613:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785787464.890891:0:6613:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1785787464.890894:0:6613:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1785787464.890896:0:6613:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1785787464.890897:0:6613:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1785787464.890898:0:6613:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785787464.890899:0:6613:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1785787464.890900:0:6613:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785787464.890900:0:6613:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785787464.890901:0:6613:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1785787464.890902:0:6613:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1785787464.890906:0:6613:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1785787464.890907:0:6613:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785787464.890908:0:6613:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1785787464.890929:0:6613:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1785787464.890945:0:6613:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:6613:1872533769950208:0@lo:253: 00000100:00100000:1.0:1785787464.891003:0:6613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787464.893754:0:6613:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190507eacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1785787464.896753:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769950208 00000100:00100000:3.0:1785787464.896762:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769950208 00000100:00100000:3.0:1785787464.896998:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1785787464.897017:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+12:6613:x1872533769950208:12345-0@lo:253: 20000000:01000000:3.0:1785787464.897055:0:5814:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1785787464.897059:0:5814:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1785787464.897063:0:5814:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1785787464.897066:0:5814:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1785787464.901768:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1785787464.901983:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1785787464.901996:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1785787464.902042:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1785787464.902050:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1785787464.903187:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1785787464.903289:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1785787464.903792:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1785787464.903814:0:5814:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.153@tcp 20000000:01000000:2.0:1785787464.903816:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.153@tcp (null) (null) (null) 00000040:00080000:2.0:1785787464.903880:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1785787464.903890:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1785787464.903937:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1785787464.903945:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.153@tcp (null) (null) 00000040:00080000:2.0:1785787464.903976:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1785787464.903992:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1785787464.904037:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1785787464.905212:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1785787464.907254:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1785787464.907272:0:5814:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.153@tcp 20000000:01000000:2.0:1785787464.907274:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.153@tcp (null) (null) (null) 00000040:00080000:2.0:1785787464.907307:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1785787464.907313:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1785787464.907340:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1785787464.907346:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.153@tcp (null) (null) 00000040:00080000:2.0:1785787464.907381:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1785787464.907391:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1785787464.907423:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1785787464.907688:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1785787464.907705:0:5814:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1785787464.907707:0:5814:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1785787464.907711:0:5814:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1785787464.907721:0:5814:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1785787464.907723:0:5814:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1785787464.907752:0:5814:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1785787464.907755:0:5814:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1785787464.918720:0:6629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1785787464.918803:0:6629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1785787464.919213:0:6629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1785787464.922686:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1785787464.922739:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1785787464.922773:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1785787464.922787:0:5814:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1785787464.922789:0:5814:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1785787464.925763:0:6630:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:1.0:1785787464.925821:0:6630:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:1.0:1785787464.925888:0:6630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1785787464.926751:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1785787464.926781:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1785787464.926870:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1785787464.926886:0:5814:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1785787464.926888:0:5814:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1785787464.929249:0:6631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1785787464.929577:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1785787464.929635:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1785787464.929701:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1785787464.929718:0:5814:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1785787464.929720:0:5814:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1785787464.929729:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1785787464.929747:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91908206a000/0xe2c2ff68a6e84271 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787464.929764:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919043c0f600/0xe2c2ff68a6e8418a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e84183 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787464.929771:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91908206b600/0xe2c2ff68a6e841a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e8419f expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787464.929777:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9190413a1000/0xe2c2ff68a6e84216 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e8420f expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787464.929797:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91908206a000/0xe2c2ff68a6e84271 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787464.929940:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9190413a1000/0xe2c2ff68a6e84216 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2c2ff68a6e8420f expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787464.929955:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9190413a1000/0xe2c2ff68a6e84216 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2c2ff68a6e8420f expref: 12 pid: 5812 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787464.929969:0:5814:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b375180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5814:1872533769950336:0@lo:104: 00000100:00100000:3.0:1785787464.930033:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787464.930163:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769950336 00000100:00100000:0.0:1785787464.930169:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769950336 00000100:00100000:0.0:1785787464.930203:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1785787464.930211:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b377480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8642023-9103-4dbf-85d1-f204189bc871+3:5814:x1872533769950336:12345-0@lo:104: 00010000:00010000:0.0:1785787464.930221:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff919043c0ec00/0xe2c2ff68a6e8420f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e84216 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787464.930266:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1785787464.930271:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b377480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8642023-9103-4dbf-85d1-f204189bc871+3:5814:x1872533769950336:12345-0@lo:104: Request processed in 61us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787464.930277:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1785787464.930296:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785787464.930301:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff919043c0ec00/0xe2c2ff68a6e8420f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e84216 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787464.930309:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0ec00 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:0.0:1785787464.930313:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff919043c0ec00/0xe2c2ff68a6e8420f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2c2ff68a6e84216 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787464.930326:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff919043c0ec00/0xe2c2ff68a6e8420f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2c2ff68a6e84216 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1785787464.930332:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff919043c0ec00/0xe2c2ff68a6e8420f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2c2ff68a6e84216 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785787464.930337:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1785787464.930362:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff919043c0ec00/0xe2c2ff68a6e8420f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e84216 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787464.930366:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785787464.930386:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff919043c0ec00/0xe2c2ff68a6e8420f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e84216 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787464.930394:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff919043c0ec00/0xe2c2ff68a6e8420f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e84216 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787464.930404:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787464.930406:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787464.930408:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787464.930632:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91908206b600/0xe2c2ff68a6e841a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2c2ff68a6e8419f expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787464.930641:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91908206b600/0xe2c2ff68a6e841a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2c2ff68a6e8419f expref: 12 pid: 5814 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787464.930649:0:5814:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b376d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5814:1872533769950592:0@lo:104: 00000100:00100000:3.0:1785787464.930671:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1785787464.930754:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919043c0f600/0xe2c2ff68a6e8418a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2c2ff68a6e84183 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787464.930761:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919043c0f600/0xe2c2ff68a6e8418a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2c2ff68a6e84183 expref: 12 pid: 5813 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787464.930767:0:5814:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b377b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5814:1872533769950720:0@lo:104: 00000100:00100000:3.0:1785787464.930785:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787464.932657:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533769950464:0@lo:103: 00000100:00100000:2.0:1785787464.932692:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787464.932733:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769950464 00000100:00100000:2.0:1785787464.932737:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769950464 00010000:00010000:2.0:1785787464.932757:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9190413a1000/0xe2c2ff68a6e84216 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e8420f expref: 13 pid: 5812 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787464.932780:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1785787464.932786:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8642023-9103-4dbf-85d1-f204189bc871+13:3333:x1872533769950464:12345-0@lo:103: 00010000:00010000:2.0:1785787464.932796:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785787464.932807:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9190413a1000/0xe2c2ff68a6e84216 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e8420f expref: 13 pid: 5812 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787464.932817:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9190413a1000/0xe2c2ff68a6e84216 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2c2ff68a6e8420f expref: 13 pid: 5812 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787464.932846:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785787464.932873:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8642023-9103-4dbf-85d1-f204189bc871+13:3333:x1872533769950464:12345-0@lo:103: Request processed in 87us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787464.932880:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1785787464.932911:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533769950464:0@lo:103: 00000100:00100000:3.0:1785787464.937656:0:5814:0:(client.c:2702:ptlrpc_set_wait()) set ffff919076bb0840 going to sleep for 11 seconds 00010000:00010000:3.0:1785787464.937687:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9190413a1000/0xe2c2ff68a6e84216 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2c2ff68a6e8420f expref: 12 pid: 5812 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787464.937714:0:5814:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b375180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5814:1872533769950336:0@lo:104: 00000100:00100000:0.0:1785787464.942682:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769950592 00000100:00100000:0.0:1785787464.942697:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769950592 00000100:00100000:0.0:1785787464.942747:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769950720 00000100:00100000:0.0:1785787464.942750:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769950720 00000100:00100000:0.0:1785787464.942770:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1785787464.942780:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b374380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8642023-9103-4dbf-85d1-f204189bc871+4:5814:x1872533769950592:12345-0@lo:104: 00010000:00010000:0.0:1785787464.942797:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff9190413a1200/0xe2c2ff68a6e8419f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e841a6 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787464.943049:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1785787464.943068:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b374380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8642023-9103-4dbf-85d1-f204189bc871+4:5814:x1872533769950592:12345-0@lo:104: Request processed in 290us (12396us total) trans 0 rc 0/0 00010000:00010000:2.0:1785787464.943148:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785787464.943156:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff9190413a1200/0xe2c2ff68a6e8419f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e841a6 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787464.943164:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413a1200 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:2.0:1785787464.943169:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff9190413a1200/0xe2c2ff68a6e8419f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2c2ff68a6e841a6 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787464.943179:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff9190413a1200/0xe2c2ff68a6e8419f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2c2ff68a6e841a6 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785787464.943187:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff9190413a1200/0xe2c2ff68a6e8419f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2c2ff68a6e841a6 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785787464.943193:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1785787464.943230:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff9190413a1200/0xe2c2ff68a6e8419f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e841a6 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787464.943237:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785787464.943262:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff9190413a1200/0xe2c2ff68a6e8419f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e841a6 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787464.943269:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff9190413a1200/0xe2c2ff68a6e8419f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e841a6 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787464.943283:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787464.943285:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787464.943286:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785787464.943301:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533769950848:0@lo:103: 00000100:00100000:2.0:1785787464.943343:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787464.943394:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769950848 00000100:00100000:2.0:1785787464.943398:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769950848 00010000:00010000:2.0:1785787464.943419:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91908206b600/0xe2c2ff68a6e841a6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e8419f expref: 12 pid: 5814 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787464.943442:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1785787464.943471:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8642023-9103-4dbf-85d1-f204189bc871+12:3334:x1872533769950848:12345-0@lo:103: 00010000:00010000:2.0:1785787464.943482:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785787464.943488:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91908206b600/0xe2c2ff68a6e841a6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e8419f expref: 12 pid: 5814 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787464.943498:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91908206b600/0xe2c2ff68a6e841a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2c2ff68a6e8419f expref: 12 pid: 5814 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787464.943514:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785787464.943543:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8642023-9103-4dbf-85d1-f204189bc871+12:3334:x1872533769950848:12345-0@lo:103: Request processed in 82us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787464.943550:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1785787464.943594:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533769950848:0@lo:103: 00000100:00100000:0.0:1785787464.943798:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1785787464.943814:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1785787464.943821:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b376a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8642023-9103-4dbf-85d1-f204189bc871+3:5814:x1872533769950720:12345-0@lo:104: 00010000:00010000:0.0:1785787464.943863:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff919040031800/0xe2c2ff68a6e84183 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e8418a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787464.943900:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1785787464.943905:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b376a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8642023-9103-4dbf-85d1-f204189bc871+3:5814:x1872533769950720:12345-0@lo:104: Request processed in 86us (13120us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787464.943911:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1785787464.943988:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785787464.943993:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff919040031800/0xe2c2ff68a6e84183 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e8418a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787464.944000:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919040031800 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:2.0:1785787464.944004:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff919040031800/0xe2c2ff68a6e84183 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2c2ff68a6e8418a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787464.944021:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff919040031800/0xe2c2ff68a6e84183 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2c2ff68a6e8418a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785787464.944028:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff919040031800/0xe2c2ff68a6e84183 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2c2ff68a6e8418a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785787464.944033:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1785787464.944053:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff919040031800/0xe2c2ff68a6e84183 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e8418a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787464.944059:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785787464.944131:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff919040031800/0xe2c2ff68a6e84183 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e8418a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787464.944138:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff919040031800/0xe2c2ff68a6e84183 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e8418a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787464.944151:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787464.944152:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787464.944154:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785787464.944164:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8642023-9103-4dbf-85d1-f204189bc871:3335:1872533769950976:0@lo:103: 00000100:00100000:2.0:1785787464.944195:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787464.944241:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769950976 00000100:00100000:2.0:1785787464.944245:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769950976 00010000:00010000:2.0:1785787464.944259:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919043c0f600/0xe2c2ff68a6e8418a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e84183 expref: 12 pid: 5813 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787464.944277:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1785787464.944283:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d8642023-9103-4dbf-85d1-f204189bc871+12:3335:x1872533769950976:12345-0@lo:103: 00010000:00010000:2.0:1785787464.944290:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785787464.944294:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919043c0f600/0xe2c2ff68a6e8418a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e84183 expref: 12 pid: 5813 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787464.944304:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919043c0f600/0xe2c2ff68a6e8418a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2c2ff68a6e84183 expref: 12 pid: 5813 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787464.944317:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91908206a000/0xe2c2ff68a6e84271 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787464.944324:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91908206a000/0xe2c2ff68a6e84271 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787464.944336:0:5806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91908206a000/0xe2c2ff68a6e84271 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787464.944342:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91908206a000/0xe2c2ff68a6e84271 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787464.944347:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91908206a000/0xe2c2ff68a6e84271 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787464.944353:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91908206a000/0xe2c2ff68a6e84271 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787464.944366:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91908206a000 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785787464.944370:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91908206a000/0xe2c2ff68a6e84271 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787464.944377:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91908206a000/0xe2c2ff68a6e84271 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787464.944385:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91908206a000/0xe2c2ff68a6e84271 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787464.944394:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785787464.944422:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d8642023-9103-4dbf-85d1-f204189bc871+12:3335:x1872533769950976:12345-0@lo:103: Request processed in 139us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787464.944428:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1785787464.945148:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8642023-9103-4dbf-85d1-f204189bc871:3335:1872533769950976:0@lo:103: 00010000:00010000:3.0:1785787464.947003:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91908206b600/0xe2c2ff68a6e841a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2c2ff68a6e8419f expref: 11 pid: 5814 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787464.947030:0:5814:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b376d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5814:1872533769950592:0@lo:104: 00010000:00010000:2.0:1785787464.951761:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919043c0f600/0xe2c2ff68a6e8418a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2c2ff68a6e84183 expref: 10 pid: 5813 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787464.951779:0:5814:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b377b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5814:1872533769950720:0@lo:104: 00010000:00010000:2.0:1785787464.951808:0:5814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91908206a000/0xe2c2ff68a6e84271 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787464.951819:0:5814:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91908206a000/0xe2c2ff68a6e84271 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787464.951851:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91908206a000/0xe2c2ff68a6e84271 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787464.951859:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91908206a000/0xe2c2ff68a6e84271 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1785787464.951889:0:5814:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1785787465.087430:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+9:6613:x1872533769950208:12345-0@lo:253: Request processed in 190415us (196417us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787465.087743:0:6613:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:6613:1872533769950208:0@lo:253: 10000000:01000000:0.0:1785787465.087757:0:6613:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1785787465.087759:0:6613:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1785787465.087761:0:6613:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1785787465.087762:0:6613:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1785787465.087763:0:6613:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1785787465.087765:0:6613:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1785787465.087766:0:6613:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1785787465.087767:0:6613:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1785787465.087768:0:6613:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1785787465.087770:0:6613:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1785787465.087770:0:6613:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1785787465.087787:0:6613:0:(tgt_mount.c:101:server_register_mount()) register mount ffff919048214000 from lustre-OST0000 10000000:01000000:0.0:1785787465.087808:0:6613:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1785787465.087810:0:6613:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1785787465.087815:0:6613:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9190515cb380 local copy 10000000:01000000:0.0:1785787465.087818:0:6613:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00100000:1.0:1785787465.088172:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:0.0:1785787465.088515:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff919040030200/0xe2c2ff68a6e84278 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787465.088542:0:6613:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.153@tcp lock: ffff919040030200/0xe2c2ff68a6e84278 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787465.088551:0:6613:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff919040030200/0xe2c2ff68a6e84278 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787465.088716:0:6613:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:6613:1872533769951104:0@lo:101: 00000100:00100000:1.0:1785787465.088749:0:6613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787465.088844:0:6613:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190507ea9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785787465.093691:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769951104 00000100:00100000:2.0:1785787465.093704:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769951104 00000100:00100000:3.0:1785787465.097802:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1785787465.097813:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+9:6613:x1872533769951104:12345-0@lo:101: 00010000:00010000:3.0:1785787465.097842:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787465.097861:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91908206b600/0xe2c2ff68a6e8427f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e84278 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787465.097895:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91908206b600/0xe2c2ff68a6e8427f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e84278 expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787465.097905:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91908206b600/0xe2c2ff68a6e8427f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e84278 expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787465.097915:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91908206b600, rc 0) 00000100:00100000:3.0:1785787465.097981:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+10:6613:x1872533769951104:12345-0@lo:101: Request processed in 170us (9232us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787465.097988:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1785787465.098089:0:6613:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:6613:1872533769951104:0@lo:101: 00010000:00010000:1.0:1785787465.098106:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff919040030200/0xe2c2ff68a6e84278 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xe2c2ff68a6e8427f expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787465.098115:0:6613:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff919040030200/0xe2c2ff68a6e84278 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe2c2ff68a6e8427f expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787465.098246:0:6613:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:6613:1872533769951232:0@lo:501: 00000100:00100000:1.0:1785787465.098276:0:6613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787465.104638:0:6613:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190507ea9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785787465.106033:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769951232 00000100:00100000:0.0:1785787465.106043:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769951232 00000100:00100000:1.0:1785787465.106994:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1785787465.107004:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051539050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+10:6613:x1872533769951232:12345-0@lo:501: 00000100:00100000:1.0:1785787465.107312:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051539050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+10:6613:x1872533769951232:12345-0@lo:501: Request processed in 308us (9034us total) trans 0 rc -2/-2 00000100:00100000:1.0:1785787465.107321:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1785787465.107375:0:6613:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:6613:1872533769951232:0@lo:501: 10000000:01000000:1.0:1785787465.107397:0:6613:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1785787465.107431:0:6613:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1785787465.107439:0:6613:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff919040030200/0xe2c2ff68a6e84278 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe2c2ff68a6e8427f expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787465.107936:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff919040030200/0xe2c2ff68a6e84278 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe2c2ff68a6e8427f expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787465.107947:0:6613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.153@tcp lock: ffff919040030200/0xe2c2ff68a6e84278 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe2c2ff68a6e8427f expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787465.107967:0:6613:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1785787465.107988:0:6613:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff919048214000 10000000:01000000:1.0:1785787465.107992:0:6613:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1785787465.107996:0:6613:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9190515cb380 10000000:01000000:1.0:1785787465.107999:0:6613:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1785787465.108002:0:6613:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9190515cb380 from 1 10000000:01000000:1.0:1785787465.108005:0:6613:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1785787465.108039:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff919043c0f000/0xe2c2ff68a6e84286 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787465.108048:0:6613:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff919043c0f000/0xe2c2ff68a6e84286 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787465.108056:0:6613:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff919043c0f000/0xe2c2ff68a6e84286 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787465.108101:0:6613:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:6613:1872533769951360:0@lo:101: 00000100:00100000:1.0:1785787465.108130:0:6613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787465.108155:0:6613:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190507ea540 going to sleep for 11 seconds 00000100:00100000:1.0:1785787465.108168:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769951360 00000100:00100000:1.0:1785787465.108172:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769951360 00000100:00100000:1.0:1785787465.108187:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1785787465.108193:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051538050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+10:6613:x1872533769951360:12345-0@lo:101: 00010000:00010000:1.0:1785787465.108200:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787465.108210:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919043c0fc00/0xe2c2ff68a6e8428d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e84286 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787465.108228:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919043c0fc00/0xe2c2ff68a6e8428d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e84286 expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787465.108238:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919043c0fc00/0xe2c2ff68a6e8428d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e84286 expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787465.108247:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919043c0fc00, rc 0) 00000100:00100000:1.0:1785787465.108271:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051538050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+11:6613:x1872533769951360:12345-0@lo:101: Request processed in 78us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787465.108275:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1785787465.108301:0:6613:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:6613:1872533769951360:0@lo:101: 00010000:00010000:1.0:1785787465.108311:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff919043c0f000/0xe2c2ff68a6e84286 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e8428d expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787465.108318:0:6613:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff919043c0f000/0xe2c2ff68a6e84286 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e8428d expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785787465.108339:0:6613:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1785787465.108348:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff919043c0f000/0xe2c2ff68a6e84286 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e8428d expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787465.108354:0:6613:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff919043c0f000/0xe2c2ff68a6e84286 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e8428d expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785787465.108359:0:6613:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1785787465.108362:0:6613:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1785787465.108365:0:6613:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1785787465.108366:0:6613:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1785787465.108377:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff919043c0f400/0xe2c2ff68a6e84294 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787465.108383:0:6613:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff919043c0f400/0xe2c2ff68a6e84294 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787465.108389:0:6613:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff919043c0f400/0xe2c2ff68a6e84294 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787465.108398:0:6613:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:6613:1872533769951488:0@lo:101: 00000100:00100000:1.0:1785787465.108418:0:6613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787465.108428:0:6613:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190507ea540 going to sleep for 11 seconds 00000100:00100000:1.0:1785787465.108439:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769951488 00000100:00100000:1.0:1785787465.108958:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769951488 00000100:00100000:1.0:1785787465.108976:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1785787465.108981:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+11:6613:x1872533769951488:12345-0@lo:101: 00010000:00010000:1.0:1785787465.108987:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787465.108998:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919043c0f800/0xe2c2ff68a6e8429b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e84294 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787465.109021:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919043c0f800/0xe2c2ff68a6e8429b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e84294 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787465.109030:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919043c0f800/0xe2c2ff68a6e8429b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e84294 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787465.109037:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919043c0f800, rc 0) 00000100:00100000:1.0:1785787465.109063:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+12:6613:x1872533769951488:12345-0@lo:101: Request processed in 82us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787465.109136:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1785787465.109165:0:6613:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:6613:1872533769951488:0@lo:101: 00010000:00010000:1.0:1785787465.109174:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff919043c0f400/0xe2c2ff68a6e84294 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e8429b expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787465.109182:0:6613:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff919043c0f400/0xe2c2ff68a6e84294 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e8429b expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787465.109232:0:6613:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:6613:1872533769951616:0@lo:501: 00000100:00100000:1.0:1785787465.109253:0:6613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787465.109264:0:6613:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190507ea540 going to sleep for 11 seconds 00000100:00100000:1.0:1785787465.109274:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769951616 00000100:00100000:1.0:1785787465.109277:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769951616 00000100:00100000:1.0:1785787465.109291:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1785787465.109296:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+12:6613:x1872533769951616:12345-0@lo:501: 00000100:00100000:1.0:1785787465.109427:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+12:6613:x1872533769951616:12345-0@lo:501: Request processed in 130us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787465.109452:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1785787465.110591:0:6613:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:6613:1872533769951616:0@lo:501: 00000100:00100000:1.0:1785787465.110855:0:6613:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:6613:1872533769951744:0@lo:503: 00000100:00100000:1.0:1785787465.110978:0:6613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787465.111022:0:6613:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190507ea540 going to sleep for 11 seconds 00010000:00010000:3.0:1785787465.111094:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785787465.111102:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff919040030200/0xe2c2ff68a6e84278 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xe2c2ff68a6e8427f expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787465.111110:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919040030200 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:3.0:1785787465.111114:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff919040030200/0xe2c2ff68a6e84278 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xe2c2ff68a6e8427f expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787465.111128:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff919040030200/0xe2c2ff68a6e84278 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xe2c2ff68a6e8427f expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785787465.111135:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff919040030200/0xe2c2ff68a6e84278 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xe2c2ff68a6e8427f expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785787465.111141:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1785787465.111159:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff919040030200/0xe2c2ff68a6e84278 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe2c2ff68a6e8427f expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787465.111165:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785787465.111190:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff919040030200/0xe2c2ff68a6e84278 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe2c2ff68a6e8427f expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787465.111196:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff919040030200/0xe2c2ff68a6e84278 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe2c2ff68a6e8427f expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787465.111209:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787465.111211:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787465.111212:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787465.111218:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785787465.111227:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8642023-9103-4dbf-85d1-f204189bc871:3335:1872533769951872:0@lo:103: 00000100:00100000:3.0:1785787465.111256:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787465.111282:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769951872 00000100:00100000:3.0:1785787465.111287:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769951872 00000100:00100000:3.0:1785787465.111320:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1785787465.111327:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b374a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8642023-9103-4dbf-85d1-f204189bc871+12:3335:x1872533769951872:12345-0@lo:103: 00010000:00010000:3.0:1785787465.111336:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787465.111348:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91908206b600/0xe2c2ff68a6e8427f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2c2ff68a6e84278 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787465.111365:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787465.111394:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b374a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8642023-9103-4dbf-85d1-f204189bc871+11:3335:x1872533769951872:12345-0@lo:103: Request processed in 67us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787465.111400:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1785787465.111426:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8642023-9103-4dbf-85d1-f204189bc871:3335:1872533769951872:0@lo:103: 00000100:00100000:0.0:1785787465.111695:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769951744 00000100:00100000:0.0:1785787465.111700:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769951744 00000100:00100000:0.0:1785787465.111728:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1785787465.111735:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051539850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+11:6613:x1872533769951744:12345-0@lo:503: 00000100:00100000:0.0:1785787465.111935:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051539850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+11:6613:x1872533769951744:12345-0@lo:503: Request processed in 200us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787465.111941:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1785787465.112808:0:6613:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:6613:1872533769951744:0@lo:503: 00000040:00080000:3.0:1785787465.113207:0:6613:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1785787465.113280:0:6613:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b374000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:6613:1872533769952000:0@lo:502: 00000100:00100000:3.0:1785787465.113324:0:6613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787465.113351:0:6613:0:(client.c:2702:ptlrpc_set_wait()) set ffff919076bb0480 going to sleep for 11 seconds 00000100:00100000:1.0:1785787465.113578:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769952000 00000100:00100000:1.0:1785787465.113583:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769952000 00000100:00100000:1.0:1785787465.113686:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1785787465.113696:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+11:6613:x1872533769952000:12345-0@lo:502: 00000100:00100000:1.0:1785787465.113949:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+11:6613:x1872533769952000:12345-0@lo:502: Request processed in 255us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787465.113958:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1785787465.114569:0:6613:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b374000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:6613:1872533769952000:0@lo:502: 00000040:00080000:3.0:1785787465.115038:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1785787465.115733:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1785787465.115770:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1785787465.115853:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1785787465.116748:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1785787465.116794:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1785787465.116869:0:6613:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b374000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:6613:1872533769952128:0@lo:502: 00000100:00100000:3.0:1785787465.117675:0:6613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787465.117758:0:6613:0:(client.c:2702:ptlrpc_set_wait()) set ffff919076bb0480 going to sleep for 11 seconds 00000100:00100000:1.0:1785787465.117944:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769952128 00000100:00100000:1.0:1785787465.117951:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769952128 00000100:00100000:1.0:1785787465.117988:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1785787465.117996:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051504c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+11:6613:x1872533769952128:12345-0@lo:502: 00000100:00100000:1.0:1785787465.118812:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051504c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+11:6613:x1872533769952128:12345-0@lo:502: Request processed in 814us (1200us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787465.118820:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1785787465.119249:0:6613:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b374000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:6613:1872533769952128:0@lo:502: 00000040:00080000:3.0:1785787465.119369:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1785787465.119382:0:6613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1785787465.125966:0:6632:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1785787465.125976:0:6632:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1785787465.125992:0:6632:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785787465.125994:0:6632:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1785787465.125999:0:6632:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1785787465.126023:0:6632:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9190507f0000) 00000020:00000080:3.0:1785787465.126043:0:6632:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1785787465.126048:0:6632:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1785787465.126127:0:6632:0:(tgt_mount.c:153:server_get_mount()) get mount ffff919048214000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1785787465.126134:0:6632:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1785787465.126140:0:6632:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe2c2ff68a6e842a9 00010000:00010000:2.0:1785787465.137804:0:6632:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1785787465.138238:0:6632:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000100:00100000:1.0:1785787465.139038:0:3334:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785787465.143697:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533769952256:0@lo:400: 00000100:00100000:1.0:1785787465.145691:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00000004:2.0:1785787465.147654:0:6632:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1785787465.147939:0:6632:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00000100:00100000:0.0:1785787465.157074:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769952256 00000100:00100000:0.0:1785787465.157088:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769952256 00000100:00100000:0.0:1785787465.157142:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1785787465.157151:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905267df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533769952256:12345-0@lo:400: 00000100:00100000:0.0:1785787465.157228:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905267df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533769952256:12345-0@lo:400: Request processed in 78us (11540us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787465.157236:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1785787465.157296:0:3334:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91907b374000 x1872533769952256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787465.157312:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533769952256:0@lo:400: 00080000:10000000:2.0:1785787465.165270:0:6632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1785787465.168364:0:6632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1785787465.173856:0:6632:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1785787465.173868:0:6632:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785787465.173895:0:6632:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785787465.173897:0:6632:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1785787465.173902:0:6632:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785787465.173906:0:6632:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785787465.173907:0:6632:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1785787465.173910:0:6632:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1785787465.173912:0:6632:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1785787465.173967:0:6632:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785787465.173971:0:6632:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785787465.173972:0:6632:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1785787465.173975:0:6632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1785787465.174183:0:6613:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1785787465.174206:0:6613:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1785787465.174227:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff919043c0f400/0xe2c2ff68a6e84294 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e8429b expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787465.174239:0:6613:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff919043c0f400/0xe2c2ff68a6e84294 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e8429b expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785787465.174247:0:6613:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff919048214000 from 1 10000000:01000000:3.0:1785787465.174250:0:6613:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1785787465.174284:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff91908206b600/0xe2c2ff68a6e842b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787465.174291:0:6613:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff91908206b600/0xe2c2ff68a6e842b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787465.174302:0:6613:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff91908206b600/0xe2c2ff68a6e842b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787465.174323:0:6613:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b375500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:6613:1872533769952384:0@lo:101: 00000100:00100000:3.0:1785787465.174387:0:6613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787465.174434:0:6613:0:(client.c:2702:ptlrpc_set_wait()) set ffff919076bb0900 going to sleep for 11 seconds 00000100:00100000:2.0:1785787465.174581:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769952384 00000100:00100000:2.0:1785787465.174588:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769952384 00000100:00100000:2.0:1785787465.174640:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1785787465.174649:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051507050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+11:6613:x1872533769952384:12345-0@lo:101: 00010000:00010000:2.0:1785787465.174660:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787465.174672:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190413a1200/0xe2c2ff68a6e842b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e842b0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787465.174693:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190413a1200/0xe2c2ff68a6e842b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e842b0 expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787465.174702:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190413a1200/0xe2c2ff68a6e842b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e842b0 expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787465.174710:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190413a1200, rc 0) 00000100:00100000:2.0:1785787465.174745:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051507050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+12:6613:x1872533769952384:12345-0@lo:101: Request processed in 97us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787465.174751:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1785787465.175584:0:6613:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b375500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:6613:1872533769952384:0@lo:101: 00010000:00010000:3.0:1785787465.175598:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff91908206b600/0xe2c2ff68a6e842b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e842b7 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787465.175606:0:6613:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff91908206b600/0xe2c2ff68a6e842b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e842b7 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787465.175699:0:6613:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b375500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:6613:1872533769952512:0@lo:501: 00000100:00100000:3.0:1785787465.175728:0:6613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787465.175761:0:6613:0:(client.c:2702:ptlrpc_set_wait()) set ffff919076bb0900 going to sleep for 11 seconds 00000100:00100000:2.0:1785787465.176049:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769952512 00000100:00100000:2.0:1785787465.176059:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769952512 00000100:00100000:2.0:1785787465.176099:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1785787465.176105:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051505c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+12:6613:x1872533769952512:12345-0@lo:501: 00000100:00100000:2.0:1785787465.176595:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051505c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+12:6613:x1872533769952512:12345-0@lo:501: Request processed in 488us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787465.176602:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1785787465.177159:0:6613:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b375500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:6613:1872533769952512:0@lo:501: 00000100:00100000:3.0:1785787465.177188:0:6613:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b375500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:6613:1872533769952640:0@lo:503: 00000100:00100000:3.0:1785787465.177223:0:6613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787465.177238:0:6613:0:(client.c:2702:ptlrpc_set_wait()) set ffff919076bb0900 going to sleep for 11 seconds 00000100:00100000:0.0:1785787465.177307:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769952640 00000100:00100000:0.0:1785787465.177311:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769952640 00000100:00100000:0.0:1785787465.177346:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1785787465.177353:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051505450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+12:6613:x1872533769952640:12345-0@lo:503: 00000100:00100000:0.0:1785787465.177566:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051505450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+12:6613:x1872533769952640:12345-0@lo:503: Request processed in 212us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787465.177572:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1785787465.188873:0:6613:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b375500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:6613:1872533769952640:0@lo:503: 00000040:00080000:2.0:1785787465.191449:0:6613:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1785787465.192458:0:6613:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:6613:1872533769952768:0@lo:502: 00000100:00100000:2.0:1785787465.193361:0:6613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787465.193418:0:6613:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190808fc3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785787465.194192:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769952768 00000100:00100000:3.0:1785787465.194199:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769952768 00000100:00100000:3.0:1785787465.194239:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1785787465.194247:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051507450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+12:6613:x1872533769952768:12345-0@lo:502: 00000100:00100000:3.0:1785787465.194472:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051507450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+12:6613:x1872533769952768:12345-0@lo:502: Request processed in 225us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787465.194479:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1785787465.194601:0:6613:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:6613:1872533769952768:0@lo:502: 00000040:00080000:2.0:1785787465.195058:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1785787465.196396:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1785787465.196435:0:6613:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:6613:1872533769952896:0@lo:502: 00000100:00100000:2.0:1785787465.197381:0:6613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787465.197420:0:6613:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190502ead80 going to sleep for 11 seconds 00000100:00100000:2.0:1785787465.197443:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769952896 00000100:00100000:2.0:1785787465.197449:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769952896 00000100:00100000:3.0:1785787465.197521:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1785787465.197532:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051504850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+12:6613:x1872533769952896:12345-0@lo:502: 00000100:00100000:3.0:1785787465.197693:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051504850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+12:6613:x1872533769952896:12345-0@lo:502: Request processed in 162us (1193us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787465.197700:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1785787465.197716:0:6613:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:6613:1872533769952896:0@lo:502: 00000040:00080000:2.0:1785787465.197807:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1785787465.197816:0:6613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1785787465.199554:0:6637:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1785787465.199564:0:6637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785787465.199566:0:6637:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1785787465.199574:0:6637:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff919048214000 00000020:00000080:2.0:1785787465.199576:0:6637:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1785787465.199603:0:6637:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1785787465.200322:0:6637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785787465.200325:0:6637:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1785787465.200330:0:6637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1785787465.200416:0:6613:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1785787465.200436:0:6613:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1785787465.200451:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff91908206b600/0xe2c2ff68a6e842b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e842b7 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787465.200463:0:6613:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff91908206b600/0xe2c2ff68a6e842b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e842b7 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785787465.200497:0:6613:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1785787465.200500:0:6613:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff919048214000 10000000:01000000:3.0:1785787465.200502:0:6613:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff919048214000 10000000:01000000:3.0:1785787465.200506:0:6613:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1785787465.200511:0:6613:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff919048214000 from 1 10000000:01000000:3.0:1785787465.200513:0:6613:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1785787465.200542:0:6613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff91908206a000/0xe2c2ff68a6e842be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787465.200549:0:6613:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff91908206a000/0xe2c2ff68a6e842be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787465.200558:0:6613:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff91908206a000/0xe2c2ff68a6e842be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787465.200572:0:6613:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b375500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:6613:1872533769953024:0@lo:101: 00000100:00100000:3.0:1785787465.200617:0:6613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787465.200647:0:6613:0:(client.c:2702:ptlrpc_set_wait()) set ffff919076bb0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1785787465.204731:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769953024 00000100:00100000:2.0:1785787465.204742:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769953024 00000100:00100000:2.0:1785787465.204797:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1785787465.204807:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051504450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+12:6613:x1872533769953024:12345-0@lo:101: 00010000:00010000:2.0:1785787465.204823:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787465.204855:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190413a1e00/0xe2c2ff68a6e842c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e842be expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787465.204882:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190413a1e00/0xe2c2ff68a6e842c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e842be expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787465.204893:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190413a1e00/0xe2c2ff68a6e842c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e842be expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787465.204902:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190413a1e00, rc 0) 00000100:00100000:2.0:1785787465.204970:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051504450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+13:6613:x1872533769953024:12345-0@lo:101: Request processed in 165us (4351us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787465.204977:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1785787465.205019:0:6613:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b375500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:6613:1872533769953024:0@lo:101: 00010000:00010000:3.0:1785787465.205035:0:6613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff91908206a000/0xe2c2ff68a6e842be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e842c5 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787465.205043:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787465.205063:0:6613:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff91908206a000/0xe2c2ff68a6e842be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e842c5 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787465.205179:0:6613:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b375500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:6613:1872533769953152:0@lo:501: 00000100:00100000:3.0:1785787465.205207:0:6613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787465.205238:0:6613:0:(client.c:2702:ptlrpc_set_wait()) set ffff919076bb0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1785787465.206144:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769953152 00000100:00100000:2.0:1785787465.206150:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769953152 00000100:00100000:2.0:1785787465.206182:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1785787465.206189:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051506050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+13:6613:x1872533769953152:12345-0@lo:501: 00000100:00100000:2.0:1785787465.207721:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051506050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+13:6613:x1872533769953152:12345-0@lo:501: Request processed in 1529us (2510us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787465.207730:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1785787465.208032:0:6613:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b375500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:6613:1872533769953152:0@lo:501: 00000100:00100000:1.0:1785787465.208073:0:6613:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:6613:1872533769953280:0@lo:503: 00000100:00100000:1.0:1785787465.208116:0:6613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787465.208151:0:6613:0:(client.c:2702:ptlrpc_set_wait()) set ffff919046ec06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785787465.208342:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769953280 00000100:00100000:2.0:1785787465.208348:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769953280 00000100:00100000:2.0:1785787465.208424:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1785787465.208432:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051506850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+13:6613:x1872533769953280:12345-0@lo:503: 00000100:00100000:2.0:1785787465.208737:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051506850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+13:6613:x1872533769953280:12345-0@lo:503: Request processed in 306us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787465.208745:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1785787465.209160:0:6613:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:6613:1872533769953280:0@lo:503: 00000040:00080000:1.0:1785787465.209424:0:6613:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1785787465.209478:0:6613:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:6613:1872533769953408:0@lo:502: 00000100:00100000:1.0:1785787465.209513:0:6613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787465.209541:0:6613:0:(client.c:2702:ptlrpc_set_wait()) set ffff919046ec06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785787465.209616:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769953408 00000100:00100000:3.0:1785787465.209621:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769953408 00000100:00100000:3.0:1785787465.209645:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1785787465.209652:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051507850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+13:6613:x1872533769953408:12345-0@lo:502: 00000100:00100000:3.0:1785787465.209808:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051507850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+13:6613:x1872533769953408:12345-0@lo:502: Request processed in 155us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787465.209815:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1785787465.209867:0:6613:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:6613:1872533769953408:0@lo:502: 00000040:00080000:2.0:1785787465.210185:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1785787465.210232:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1785787465.212478:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1785787465.212750:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1785787465.212786:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1785787465.212901:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1785787465.212942:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1785787465.212977:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1785787465.213038:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1785787465.215170:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1785787465.215553:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1785787465.215690:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1785787465.215727:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1785787465.215756:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1785787465.215797:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1785787465.215872:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1785787465.215913:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1785787465.215965:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1785787465.216000:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1785787465.216042:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1785787465.217714:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1785787465.217770:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1785787465.217799:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1785787465.218057:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1785787465.218102:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1785787465.218140:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1785787465.218206:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1785787465.218255:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1785787465.218300:0:6613:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b374000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:6613:1872533769953536:0@lo:502: 00000100:00100000:3.0:1785787465.218478:0:6613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787465.218528:0:6613:0:(client.c:2702:ptlrpc_set_wait()) set ffff919076bb0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1785787465.218578:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769953536 00000100:00100000:2.0:1785787465.218585:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769953536 00000100:00100000:2.0:1785787465.219360:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1785787465.219380:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051505050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+13:6613:x1872533769953536:12345-0@lo:502: 00000100:00100000:2.0:1785787465.219757:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051505050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+13:6613:x1872533769953536:12345-0@lo:502: Request processed in 388us (1279us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787465.219766:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1785787465.220050:0:6613:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b374000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:6613:1872533769953536:0@lo:502: 00000040:00080000:3.0:1785787465.220131:0:6613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1785787465.220142:0:6613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1785787465.222695:0:6638:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1785787465.222711:0:6638:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff919056a7cd40) 00000020:00000080:1.0:1785787465.222730:0:6638:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1785787465.222904:0:6638:0:(tgt_mount.c:153:server_get_mount()) get mount ffff919048214000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1785787465.222908:0:6638:0:(tgt_mount.c:187:server_put_mount()) put mount ffff919048214000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1785787465.222911:0:6638:0:(obd_mount.c:710:lustre_put_lsi()) put ffff919048214000 3 00010000:00080000:1.0:1785787465.222934:0:6638:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91907fe69800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.153@tcp at head 00010000:00010000:1.0:1785787465.224873:0:6638:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1785787465.224952:0:6638:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1785787465.224978:0:6638:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1785787465.224987:0:6638:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xe2c2ff68a6e842d3 00000100:00080000:1.0:1785787465.224995:0:6638:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1785787465.225000:0:6638:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff91907fe69800 using connection 192.168.203.153@tcp/0@lo 00000100:00100000:1.0:1785787465.225053:0:6638:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91905267d880 x1872533769953664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1785787465.225079:0:6638:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1785787465.225141:0:3332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1872533769953664:0@lo:38: 00000100:00100000:2.0:1785787465.225201:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1785787465.231440:0:6638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1785787465.231614:0:6613:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1785787465.231635:0:6613:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1785787465.231656:0:6613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff91908206a000/0xe2c2ff68a6e842be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e842c5 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787465.231668:0:6613:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff91908206a000/0xe2c2ff68a6e842be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e842c5 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787465.231690:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769953664 00000100:00100000:1.0:1785787465.231699:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769953664 00000020:01000004:2.0:1785787465.231710:0:6613:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1785787465.231712:0:6613:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1785787465.231713:0:6613:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1785787465.231714:0:6613:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1785787465.231715:0:6613:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1785787465.231717:0:6613:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1785787465.231718:0:6613:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1785787465.231720:0:6613:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1785787465.231721:0:6613:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1785787465.231723:0:6613:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1785787465.231724:0:6613:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1785787465.231727:0:6613:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1785787465.231730:0:6613:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000100:00100000:1.0:1785787465.231730:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000020:01000004:2.0:1785787465.231731:0:6613:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1785787465.231733:0:6613:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1785787465.231734:0:6613:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000100:00100000:1.0:1785787465.231737:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3332:x1872533769953664:12345-0@lo:38: 00000020:01000004:2.0:1785787465.231739:0:6613:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1785787465.231741:0:6613:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1785787465.231742:0:6613:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1785787465.231743:0:6613:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1785787465.231744:0:6613:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1785787465.231745:0:6613:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1785787465.231745:0:6613:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00080000:1.0:1785787465.231761:0:5821:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 252 last 0 10000000:01000000:2.0:1785787465.231764:0:6613:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1785787465.231778:0:6613:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:6613:1872533769953792:0@lo:253: 00000020:00000080:1.0:1785787465.231803:0:5821:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xe2c2ff68a6e842da 00000004:00100000:1.0:1785787465.231820:0:5821:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1785787465.231860:0:6613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787465.231902:0:6613:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190502ea0c0 going to sleep for 11 seconds 00000100:00080000:1.0:1785787465.233147:0:5821:0:(import.c:65:import_set_state_nolock()) ffff91907fe6b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1785787465.233209:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3332:x1872533769953664:12345-0@lo:38: Request processed in 1470us (8007us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787465.233216:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1785787465.233231:0:3332:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91905267d880 x1872533769953664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1785787475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787465.233241:0:3332:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00100000:1.0:1785787465.233246:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769953792 00000100:00080000:2.0:1785787465.233248:0:3332:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00100000:1.0:1785787465.233250:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769953792 00000100:00080000:2.0:1785787465.233266:0:3332:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1785787465.233270:0:3332:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1785787465.233272:0:3332:0:(import.c:65:import_set_state_nolock()) ffff91907fe69800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1785787465.233277:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1785787465.233278:0:3332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1872533769953664:0@lo:38: 00000100:00100000:1.0:1785787465.233283:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051504050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+13:6613:x1872533769953792:12345-0@lo:253: 20000000:01000000:1.0:1785787465.233301:0:5812:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1785787465.233313:0:5812:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1785787465.344390:0:5812:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1785787465.344408:0:5812:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1785787465.344576:0:5836:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1785787465.344581:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1785787465.344600:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91908206bc00/0xe2c2ff68a6e842e1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787465.344635:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9190413a0400/0xe2c2ff68a6e84240 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e84239 expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787465.344644:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91908206bc00/0xe2c2ff68a6e842e1 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787465.344676:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9190413a0400/0xe2c2ff68a6e84240 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2c2ff68a6e84239 expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787465.344689:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9190413a0400/0xe2c2ff68a6e84240 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2c2ff68a6e84239 expref: 13 pid: 5812 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787465.344702:0:5836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b374000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5836:1872533769953920:0@lo:104: 00000100:00100000:3.0:1785787465.344865:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787465.345076:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769953920 00000100:00100000:1.0:1785787465.345084:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769953920 00000100:00100000:1.0:1785787465.345133:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1785787465.345142:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b377b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8642023-9103-4dbf-85d1-f204189bc871+3:5836:x1872533769953920:12345-0@lo:104: 00010000:00010000:1.0:1785787465.345153:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff9190413a0600/0xe2c2ff68a6e84239 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e84240 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787465.345196:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1785787465.345202:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b377b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8642023-9103-4dbf-85d1-f204189bc871+3:5836:x1872533769953920:12345-0@lo:104: Request processed in 62us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787465.345209:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1785787465.345376:0:5836:0:(client.c:2702:ptlrpc_set_wait()) set ffff919076bb0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1785787465.345399:0:5836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b374000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5836:1872533769953920:0@lo:104: 00010000:00010000:2.0:1785787465.345416:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91908206bc00/0xe2c2ff68a6e842e1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787465.345598:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785787465.345613:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff9190413a0600/0xe2c2ff68a6e84239 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e84240 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787465.345622:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413a0600 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:3.0:1785787465.345626:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff9190413a0600/0xe2c2ff68a6e84239 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2c2ff68a6e84240 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787465.345635:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff9190413a0600/0xe2c2ff68a6e84239 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2c2ff68a6e84240 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785787465.345642:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff9190413a0600/0xe2c2ff68a6e84239 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2c2ff68a6e84240 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785787465.345647:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1785787465.345688:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff9190413a0600/0xe2c2ff68a6e84239 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e84240 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787465.345694:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785787465.345720:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff9190413a0600/0xe2c2ff68a6e84239 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e84240 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787465.345727:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff9190413a0600/0xe2c2ff68a6e84239 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e84240 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787465.345742:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785787465.345953:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533769954048:0@lo:103: 00000100:00100000:1.0:1785787465.345983:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1785787465.346076:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787465.346079:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785787465.346948:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769954048 00000100:00100000:2.0:1785787465.346954:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769954048 00010000:00010000:2.0:1785787465.346977:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9190413a0400/0xe2c2ff68a6e84240 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e84239 expref: 14 pid: 5812 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787465.347019:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1785787465.347027:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051465c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8642023-9103-4dbf-85d1-f204189bc871+14:3334:x1872533769954048:12345-0@lo:103: 00010000:00010000:2.0:1785787465.347046:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785787465.347052:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9190413a0400/0xe2c2ff68a6e84240 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e84239 expref: 14 pid: 5812 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787465.347063:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9190413a0400/0xe2c2ff68a6e84240 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2c2ff68a6e84239 expref: 14 pid: 5812 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787465.347202:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9190413a0400/0xe2c2ff68a6e84240 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2c2ff68a6e84239 expref: 14 pid: 5812 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787465.347215:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91908206bc00/0xe2c2ff68a6e842e1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787465.347222:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91908206bc00/0xe2c2ff68a6e842e1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1785787465.347235:0:5807:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002654693s 00010000:00010000:2.0:1785787465.347239:0:5807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91908206bc00/0xe2c2ff68a6e842e1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787465.347245:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91908206bc00/0xe2c2ff68a6e842e1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787465.347305:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91908206bc00/0xe2c2ff68a6e842e1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787465.347313:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91908206bc00/0xe2c2ff68a6e842e1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787465.347319:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91908206bc00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785787465.347323:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91908206bc00/0xe2c2ff68a6e842e1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787465.347336:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91908206bc00/0xe2c2ff68a6e842e1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787465.358128:0:5836:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91908206bc00/0xe2c2ff68a6e842e1 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787465.358165:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91908206bc00/0xe2c2ff68a6e842e1 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787465.358843:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91908206bc00/0xe2c2ff68a6e842e1 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787465.358855:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91908206bc00/0xe2c2ff68a6e842e1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787465.358876:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785787465.359031:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051465c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8642023-9103-4dbf-85d1-f204189bc871+13:3334:x1872533769954048:12345-0@lo:103: Request processed in 12001us (13042us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787465.359042:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1785787465.359427:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533769954048:0@lo:103: 00000100:00100000:3.0:1785787465.371723:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051504050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+12:6613:x1872533769953792:12345-0@lo:253: Request processed in 138431us (139854us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787465.371737:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1785787465.371894:0:6613:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:6613:1872533769953792:0@lo:253: 10000000:01000000:2.0:1785787465.371910:0:6613:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1785787465.371912:0:6613:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1785787465.371914:0:6613:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1785787465.371916:0:6613:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1785787465.371917:0:6613:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1785787465.371918:0:6613:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1785787465.371919:0:6613:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1785787465.371921:0:6613:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1785787465.371922:0:6613:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1785787465.371923:0:6613:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1785787465.371925:0:6613:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1785787465.371927:0:6613:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1785787465.371938:0:6613:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1785787465.387812:0:6613:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1785787465.388390:0:6613:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1785787465.389360:0:6613:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1785787465.390166:0:6613:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1785787465.390730:0:6613:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1785787465.393472:0:6613:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1785787465.403957:0:6613:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1785787465.802463:0:6613:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1785787465.802470:0:6613:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1785787465.802502:0:6613:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1785787465.802558:0:6613:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.153@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1785787465.802571:0:6613:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1785787465.802596:0:6613:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1785787466.226985:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787467.264598:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1785787467.507212:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1785787467.507219:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff919056a98000 from 21 10000000:01000000:2.0:1785787467.507224:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1785787467.507269:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff9190413a1000/0xe2c2ff68a6e842e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787467.507280:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff9190413a1000/0xe2c2ff68a6e842e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787467.507291:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff9190413a1000/0xe2c2ff68a6e842e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787467.507314:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769954176:0@lo:101: 00000100:00100000:2.0:1785787467.507377:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787467.507450:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff919077954840 going to sleep for 11 seconds 00000100:00100000:0.0:1785787467.507687:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769954176 00000100:00100000:0.0:1785787467.507695:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769954176 00000100:00100000:0.0:1785787467.507751:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1785787467.507761:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051507c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+12:5818:x1872533769954176:12345-0@lo:101: 00010000:00010000:0.0:1785787467.507773:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787467.507786:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919040030400/0xe2c2ff68a6e842ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e842e8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787467.507808:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919040030400/0xe2c2ff68a6e842ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e842e8 expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787467.507867:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919040030400/0xe2c2ff68a6e842ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e842e8 expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787467.507877:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919040030400, rc 0) 00000100:00100000:0.0:1785787467.507911:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051507c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+13:5818:x1872533769954176:12345-0@lo:101: Request processed in 152us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787467.507918:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1785787467.508166:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769954176:0@lo:101: 00010000:00010000:2.0:1785787467.508230:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff9190413a1000/0xe2c2ff68a6e842e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e842ef expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787467.508240:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff9190413a1000/0xe2c2ff68a6e842e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e842ef expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787467.508287:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769954304:0@lo:501: 00000100:00100000:2.0:1785787467.508309:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787467.508472:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff919077954840 going to sleep for 11 seconds 00000100:00100000:3.0:1785787467.512280:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769954304 00000100:00100000:3.0:1785787467.512292:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769954304 00000100:00100000:0.0:1785787467.512406:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1785787467.512416:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051506c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+13:5818:x1872533769954304:12345-0@lo:501: 00000100:00100000:0.0:1785787467.513202:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051506c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+13:5818:x1872533769954304:12345-0@lo:501: Request processed in 786us (4890us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787467.513209:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1785787467.517052:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769954304:0@lo:501: 00000100:00100000:2.0:1785787467.517122:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769954432:0@lo:503: 00000100:00100000:2.0:1785787467.517579:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787467.517867:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff919077954840 going to sleep for 11 seconds 00000100:00100000:0.0:1785787467.522802:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769954432 00000100:00100000:0.0:1785787467.522815:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769954432 00000100:00100000:0.0:1785787467.522975:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1785787467.522985:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051505850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+13:5818:x1872533769954432:12345-0@lo:503: 00000100:00100000:0.0:1785787467.524297:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051505850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+13:5818:x1872533769954432:12345-0@lo:503: Request processed in 1310us (6715us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787467.524307:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1785787467.524700:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769954432:0@lo:503: 00000100:00100000:2.0:1785787467.527421:0:6710:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:6710:1872533769954560:0@lo:502: 00000100:00100000:2.0:1785787467.527487:0:6710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787467.533221:0:6710:0:(client.c:2702:ptlrpc_set_wait()) set ffff919077954780 going to sleep for 11 seconds 00000100:00100000:3.0:1785787467.533555:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769954560 00000100:00100000:3.0:1785787467.533563:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769954560 00000100:00100000:3.0:1785787467.533605:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1785787467.533615:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051506450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+13:6710:x1872533769954560:12345-0@lo:502: 00000100:00100000:3.0:1785787467.533939:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051506450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+13:6710:x1872533769954560:12345-0@lo:502: Request processed in 326us (6451us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787467.533948:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1785787467.534284:0:6710:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:6710:1872533769954560:0@lo:502: 00000100:00100000:2.0:1785787467.534344:0:6710:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:6710:1872533769954688:0@lo:502: 00000100:00100000:2.0:1785787467.534387:0:6710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787467.534403:0:6710:0:(client.c:2702:ptlrpc_set_wait()) set ffff919077954780 going to sleep for 11 seconds 00000100:00100000:3.0:1785787467.535140:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769954688 00000100:00100000:3.0:1785787467.535146:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769954688 00000100:00100000:3.0:1785787467.535166:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1785787467.535228:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+13:6710:x1872533769954688:12345-0@lo:502: 00000100:00100000:3.0:1785787467.535374:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+13:6710:x1872533769954688:12345-0@lo:502: Request processed in 149us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787467.535381:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1785787467.535466:0:6710:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:6710:1872533769954688:0@lo:502: 00000040:00080000:2.0:1785787467.535484:0:6710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1785787467.536466:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1785787467.536486:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1785787467.536494:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff9190413a1000/0xe2c2ff68a6e842e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e842ef expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787467.536515:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff9190413a1000/0xe2c2ff68a6e842e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e842ef expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785787467.536525:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1785787467.536527:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff919056a98000 from 4 10000000:01000000:3.0:1785787467.536530:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1785787467.536555:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff91908206a200/0xe2c2ff68a6e842f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787467.536563:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff91908206a200/0xe2c2ff68a6e842f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787467.536571:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff91908206a200/0xe2c2ff68a6e842f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787467.536585:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b375180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769954816:0@lo:101: 00000100:00100000:3.0:1785787467.536618:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787467.536643:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff918f42eee780 going to sleep for 11 seconds 00000100:00100000:3.0:1785787467.536664:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769954816 00000100:00100000:3.0:1785787467.536668:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769954816 00000100:00100000:3.0:1785787467.536688:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1785787467.536694:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+13:5818:x1872533769954816:12345-0@lo:101: 00010000:00010000:3.0:1785787467.536704:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787467.536715:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91908206ae00/0xe2c2ff68a6e842fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e842f6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787467.536750:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91908206ae00/0xe2c2ff68a6e842fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e842f6 expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787467.536760:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91908206ae00/0xe2c2ff68a6e842fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e842f6 expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787467.536774:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91908206ae00, rc 0) 00000100:00100000:3.0:1785787467.536813:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+14:5818:x1872533769954816:12345-0@lo:101: Request processed in 118us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787467.536819:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1785787467.536909:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b375180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769954816:0@lo:101: 00010000:00010000:3.0:1785787467.536920:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff91908206a200/0xe2c2ff68a6e842f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e842fd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787467.536928:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff91908206a200/0xe2c2ff68a6e842f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e842fd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787467.537118:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b375180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769954944:0@lo:256: 00000100:00100000:3.0:1785787467.537145:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787467.537153:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff918f42eee780 going to sleep for 11 seconds 00000100:00100000:3.0:1785787467.537168:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769954944 00000100:00100000:3.0:1785787467.537186:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769954944 00000100:00100000:3.0:1785787467.537202:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1785787467.537207:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+14:5818:x1872533769954944:12345-0@lo:256: 20000000:01000000:3.0:1785787467.537218:0:5812:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1785787467.537231:0:5812:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1785787467.537234:0:5812:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1785787467.537305:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+14:5818:x1872533769954944:12345-0@lo:256: Request processed in 96us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787467.537311:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1785787467.537329:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b375180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769954944:0@lo:256: 10000000:01000000:3.0:1785787467.537358:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1785787467.537363:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff91908206a200/0xe2c2ff68a6e842f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e842fd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787467.537370:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff91908206a200/0xe2c2ff68a6e842f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e842fd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785787467.537376:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1785787467.537378:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1785787467.537380:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1785787467.537392:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff91908206a400/0xe2c2ff68a6e84304 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787467.537398:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff91908206a400/0xe2c2ff68a6e84304 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787467.537405:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff91908206a400/0xe2c2ff68a6e84304 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787467.537414:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b375180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769955072:0@lo:101: 00000100:00100000:3.0:1785787467.537439:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787467.537458:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff918f42eee780 going to sleep for 11 seconds 00000100:00100000:3.0:1785787467.537472:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769955072 00000100:00100000:3.0:1785787467.537475:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769955072 00000100:00100000:3.0:1785787467.537488:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1785787467.537493:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+14:5818:x1872533769955072:12345-0@lo:101: 00010000:00010000:3.0:1785787467.537508:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787467.537516:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91908206bc00/0xe2c2ff68a6e8430b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e84304 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787467.537529:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91908206bc00/0xe2c2ff68a6e8430b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e84304 expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787467.537536:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91908206bc00/0xe2c2ff68a6e8430b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e84304 expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787467.537543:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91908206bc00, rc 0) 00000100:00100000:3.0:1785787467.537565:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+15:5818:x1872533769955072:12345-0@lo:101: Request processed in 72us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787467.537571:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1785787467.537590:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b375180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769955072:0@lo:101: 00010000:00010000:3.0:1785787467.537599:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff91908206a400/0xe2c2ff68a6e84304 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e8430b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787467.537606:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff91908206a400/0xe2c2ff68a6e84304 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e8430b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787467.537642:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b375180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769955200:0@lo:501: 00000100:00100000:3.0:1785787467.537673:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787467.537681:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff918f42eee780 going to sleep for 11 seconds 00000100:00100000:3.0:1785787467.537695:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769955200 00000100:00100000:3.0:1785787467.537698:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769955200 00000100:00100000:3.0:1785787467.537713:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1785787467.537718:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+15:5818:x1872533769955200:12345-0@lo:501: 00000100:00100000:3.0:1785787467.537942:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+15:5818:x1872533769955200:12345-0@lo:501: Request processed in 222us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787467.537948:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1785787467.540114:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b375180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769955200:0@lo:501: 00000100:00100000:3.0:1785787467.540289:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b375180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769955328:0@lo:503: 00000100:00100000:3.0:1785787467.540354:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787467.540375:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff918f42eee780 going to sleep for 11 seconds 00000100:00100000:3.0:1785787467.540409:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769955328 00000100:00100000:3.0:1785787467.540415:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769955328 00000100:00100000:3.0:1785787467.540447:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1785787467.540454:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+15:5818:x1872533769955328:12345-0@lo:503: 00000100:00100000:3.0:1785787467.541127:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+15:5818:x1872533769955328:12345-0@lo:503: Request processed in 672us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787467.541141:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1785787467.544111:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b375180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769955328:0@lo:503: 00000100:00100000:3.0:1785787467.545401:0:6711:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b375180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:6711:1872533769955456:0@lo:502: 00000100:00100000:3.0:1785787467.545471:0:6711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787467.545891:0:6711:0:(client.c:2702:ptlrpc_set_wait()) set ffff918f42eeeb40 going to sleep for 11 seconds 00000100:00100000:1.0:1785787467.546662:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769955456 00000100:00100000:1.0:1785787467.546685:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769955456 00000100:00100000:0.0:1785787467.560112:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1785787467.560125:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+15:6711:x1872533769955456:12345-0@lo:502: 00000100:00100000:0.0:1785787467.560430:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+15:6711:x1872533769955456:12345-0@lo:502: Request processed in 306us (14965us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787467.560438:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1785787467.560630:0:6711:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b375180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:6711:1872533769955456:0@lo:502: 00000020:01000000:1.0:1785787467.560662:0:6711:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1785787467.560669:0:6711:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1785787467.560676:0:6711:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785787467.560678:0:6711:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1785787467.560683:0:6711:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1785787467.560687:0:6711:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.153@tcp to nid 0x20000c0a8cb99 (192.168.203.153@tcp) 00000020:01000000:1.0:1785787467.560706:0:6711:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1785787467.560710:0:6711:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1785787467.560723:0:6711:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff919056a78000) 00000020:00000080:1.0:1785787467.560741:0:6711:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1785787467.560747:0:6711:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1785787467.560818:0:6711:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1785787467.560823:0:6711:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:1.0:1785787467.560862:0:6711:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe2c2ff68a6e84319 00010000:00080000:1.0:1785787467.560889:0:6711:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91907fe6e000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.153@tcp at head 00010000:00010000:1.0:1785787467.561125:0:6711:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1785787467.690453:0:6711:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1785787467.690472:0:6711:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1785787467.690983:0:6711:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1785787467.691306:0:6711:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1785787467.691358:0:6711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1785787467.691414:0:6711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1785787467.697122:0:6714:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1785787467.697134:0:6714:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1785787467.728594:0:6711:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1785787467.728615:0:6711:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1785787467.728651:0:6711:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1785787467.728671:0:6711:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe2c2ff68a6e84320 00000100:00080000:0.0:1785787467.728680:0:6711:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1785787467.728685:0:6711:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91907fe6e000 using connection 192.168.203.153@tcp/0@lo 00000100:00100000:0.0:1785787467.728717:0:6711:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff919077a98e00 x1872533769955584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1785787467.728743:0:6711:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1785787467.728797:0:6711:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785787467.728801:0:6711:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785787467.728803:0:6711:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1785787467.728806:0:6711:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785787467.728809:0:6711:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785787467.728811:0:6711:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:0.0:1785787467.728814:0:6711:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1785787467.728816:0:6711:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1785787467.728867:0:6711:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:6711:1872533769955712:0@lo:502: 00000100:00100000:0.0:1785787467.728934:0:6711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787467.728978:0:6711:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905c4c2300 going to sleep for 11 seconds 00000100:00100000:2.0:1785787467.731278:0:3332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3332:1872533769955584:0@lo:8: 00000100:00100000:2.0:1785787467.731326:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787467.731380:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769955584 00000100:00100000:2.0:1785787467.731387:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769955584 00000100:00100000:2.0:1785787467.731418:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1785787467.731424:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3332:x1872533769955584:12345-0@lo:8: 00010000:00080000:2.0:1785787467.731448:0:6617:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 254 last 0 00000020:00000080:2.0:1785787467.731472:0:6617:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe2c2ff68a6e84327 00002000:00100000:2.0:1785787467.731501:0:6617:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff919048215800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113801 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1785787467.731505:0:6617:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1785787467.731509:0:6617:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1785787467.731623:0:6617:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1785787467.731768:0:6617:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1785787467.731791:0:6617:0:(import.c:65:import_set_state_nolock()) ffff919048213800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1785787467.731857:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3332:x1872533769955584:12345-0@lo:8: Request processed in 431us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787467.731864:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1785787467.731900:0:3332:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919077a98e00 x1872533769955584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1785787477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787467.731909:0:3332:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1785787467.731916:0:3332:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1785787467.731923:0:3332:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1785787467.731927:0:3332:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1785787467.731929:0:3332:0:(import.c:65:import_set_state_nolock()) ffff91907fe6e000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1785787467.731938:0:3332:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1785787467.731943:0:3332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3332:1872533769955584:0@lo:8: 00000100:00100000:2.0:1785787467.735243:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3336:1872533769955968:0@lo:400: 00000100:00100000:2.0:1785787467.735296:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787467.735335:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785787467.735341:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3336:1872533769955840:0@lo:400: 00000100:00100000:2.0:1785787467.735364:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787467.735404:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769955968 00000100:00100000:2.0:1785787467.735411:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769955968 00000100:00100000:2.0:1785787467.735446:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769955840 00000100:00100000:2.0:1785787467.735449:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769955840 00000100:00100000:2.0:1785787467.735461:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1785787467.735467:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3336:x1872533769955968:12345-0@lo:400: 00000100:00100000:2.0:1785787467.735507:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3336:x1872533769955968:12345-0@lo:400: Request processed in 39us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787467.735523:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1785787467.735538:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1785787467.735542:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3336:x1872533769955840:12345-0@lo:400: 00000100:00100000:2.0:1785787467.735565:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3336:x1872533769955840:12345-0@lo:400: Request processed in 22us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787467.735570:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1785787467.735584:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1785787467.735594:0:6714:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1785787467.735734:0:6714:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 254979905007ns, next at 0ns, rc = 0 00010000:00080000:2.0:1785787467.735970:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91907b376300 x1872533769955840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787467.735983:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3336:1872533769955840:0@lo:400: 00010000:00080000:2.0:1785787467.736004:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91907b374e00 x1872533769955968/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787467.736012:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3336:1872533769955968:0@lo:400: 00000100:00100000:1.0:1785787467.736340:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769955712 00000100:00100000:1.0:1785787467.736345:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769955712 00000100:00100000:1.0:1785787467.736371:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1785787467.736377:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+15:6711:x1872533769955712:12345-0@lo:502: 00000100:00100000:1.0:1785787467.736550:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+15:6711:x1872533769955712:12345-0@lo:502: Request processed in 173us (7615us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787467.736557:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1785787467.736667:0:6711:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:6711:1872533769955712:0@lo:502: 00000020:01000000:1.0:1785787467.736695:0:6711:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1785787467.736701:0:6711:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785787467.736704:0:6711:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:1.0:1785787467.736708:0:6711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1785787467.736758:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1785787467.736771:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1785787467.736779:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff91908206a400/0xe2c2ff68a6e84304 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e8430b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787467.736789:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff91908206a400/0xe2c2ff68a6e84304 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e8430b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785787467.736798:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1785787467.736801:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9190515cb380 from 1 10000000:01000000:1.0:1785787467.736803:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1785787467.736841:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff919043c0e600/0xe2c2ff68a6e8432e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787467.736848:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff919043c0e600/0xe2c2ff68a6e8432e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787467.736877:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff919043c0e600/0xe2c2ff68a6e8432e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787467.736891:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769956096:0@lo:101: 00000100:00100000:1.0:1785787467.736916:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787467.736937:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190469d16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785787467.736950:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769956096 00000100:00100000:1.0:1785787467.736953:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769956096 00000100:00100000:1.0:1785787467.736970:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1785787467.736976:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+15:5818:x1872533769956096:12345-0@lo:101: 00010000:00010000:1.0:1785787467.736983:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787467.737005:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919043c0fa00/0xe2c2ff68a6e84335 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e8432e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787467.737025:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919043c0fa00/0xe2c2ff68a6e84335 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e8432e expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787467.737034:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919043c0fa00/0xe2c2ff68a6e84335 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e8432e expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787467.737042:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919043c0fa00, rc 0) 00000100:00100000:1.0:1785787467.737068:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+16:5818:x1872533769956096:12345-0@lo:101: Request processed in 91us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787467.737073:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1785787467.737102:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769956096:0@lo:101: 00010000:00010000:1.0:1785787467.737113:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff919043c0e600/0xe2c2ff68a6e8432e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84335 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787467.737131:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff919043c0e600/0xe2c2ff68a6e8432e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e84335 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787467.737239:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769956224:0@lo:501: 00000100:00100000:1.0:1785787467.737265:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787467.737276:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190469d16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785787467.737288:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769956224 00000100:00100000:1.0:1785787467.737291:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769956224 00000100:00100000:1.0:1785787467.737308:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1785787467.737315:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051581050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+16:5818:x1872533769956224:12345-0@lo:501: 00000100:00100000:1.0:1785787467.737468:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051581050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+16:5818:x1872533769956224:12345-0@lo:501: Request processed in 153us (202us total) trans 0 rc -2/-2 00000100:00100000:1.0:1785787467.737474:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1785787467.737502:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769956224:0@lo:501: 10000000:01000000:1.0:1785787467.737517:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1785787467.737522:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff919043c0e600/0xe2c2ff68a6e8432e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84335 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787467.737530:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff919043c0e600/0xe2c2ff68a6e8432e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84335 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785787467.858679:0:6716:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1785787467.859202:0:6716:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a99f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6716:1872533769956480:0@lo:7: 00000100:00100000:0.0:1785787467.859266:0:6716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787467.859311:0:6716:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905c4c2000 going to sleep for 11 seconds 00000100:00100000:0.0:1785787467.859359:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533769956352:0@lo:13: 00000100:00100000:0.0:1785787467.859384:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787467.859435:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769956480 00000100:00100000:0.0:1785787467.859441:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769956480 00000100:00100000:0.0:1785787467.859487:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1785787467.859495:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6716:x1872533769956480:12345-0@lo:7: 00002000:00080000:0.0:1785787467.874590:0:6619:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1785787467.874598:0:6619:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1785787467.874688:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6716:x1872533769956480:12345-0@lo:7: Request processed in 15190us (15419us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787467.874698:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1785787467.874742:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769956352 00000100:00100000:0.0:1785787467.874750:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769956352 00010000:00080000:2.0:1785787467.875390:0:6716:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919077a99f80 x1872533769956480/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1785787483 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787467.875405:0:6716:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a99f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6716:1872533769956480:0@lo:7: 00000004:00080000:2.0:1785787467.875418:0:6716:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1785787467.875454:0:6716:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6716:1872533769956608:0@lo:5: 00000100:00100000:2.0:1785787467.875486:0:6716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787467.875524:0:6716:0:(client.c:2702:ptlrpc_set_wait()) set ffff919077954f00 going to sleep for 11 seconds 00000100:00100000:2.0:1785787467.875540:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769956608 00000100:00100000:2.0:1785787467.875543:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769956608 00000100:00100000:2.0:1785787467.875576:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1785787467.875583:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6716:x1872533769956608:12345-0@lo:5: 00002000:00080000:2.0:1785787467.875604:0:6618:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1785787467.875607:0:6618:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1785787467.875804:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:6716:x1872533769956608:12345-0@lo:5: Request processed in 221us (317us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1785787467.875811:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1785787467.875855:0:6716:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919077a9f800 x1872533769956608/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1785787483 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787467.875867:0:6716:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6716:1872533769956608:0@lo:5: 00000004:00080000:2.0:1785787467.875875:0:6716:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1785787467.876000:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1785787467.876009:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3333:x1872533769956352:12345-0@lo:13: 00002000:00000024:0.0:1785787467.876028:0:6620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1785787467.876065:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3333:x1872533769956352:12345-0@lo:13: Request processed in 58us (16680us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787467.876071:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1785787467.886038:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1785787467.889859:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919077a9b100 x1872533769956352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787483 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787467.889899:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533769956352:0@lo:13: 00000004:00080000:1.0:1785787467.952927:0:5843:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1785787468.277469:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787469.299615:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787470.323678:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787471.347636:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1785787471.455928:0:6642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1785787471.455947:0:6642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1785787472.375901:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787472.827186:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3335:1872533769956864:0@lo:400: 00000100:00100000:0.0:1785787472.827249:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787472.827307:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785787472.827314:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533769956992:0@lo:400: 00000100:00100000:0.0:1785787472.827341:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787472.827376:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769956864 00000100:00100000:0.0:1785787472.827383:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769956864 00000100:00100000:0.0:1785787472.827420:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769956992 00000100:00100000:0.0:1785787472.827423:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769956992 00000100:00100000:0.0:1785787472.827448:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1785787472.827455:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3335:x1872533769956864:12345-0@lo:400: 00000100:00100000:0.0:1785787472.827501:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3335:x1872533769956864:12345-0@lo:400: Request processed in 46us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787472.827519:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1785787472.827537:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1785787472.827543:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533769956992:12345-0@lo:400: 00000100:00100000:0.0:1785787472.827573:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533769956992:12345-0@lo:400: Request processed in 30us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787472.827578:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1785787472.827594:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1785787472.827616:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919077a99c00 x1872533769956992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787472.827628:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533769956992:0@lo:400: 00010000:00080000:0.0:1785787472.827637:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919077a9b800 x1872533769956864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787472.827644:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3335:1872533769956864:0@lo:400: 00000100:00100000:1.0:1785787472.827718:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533769957120:0@lo:400: 00000100:00100000:1.0:1785787472.827751:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787472.827783:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785787472.827789:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533769956736:0@lo:400: 00000100:00100000:1.0:1785787472.827823:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787472.827868:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769956736 00000100:00100000:1.0:1785787472.827871:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769956736 00000100:00100000:1.0:1785787472.827897:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1785787472.827904:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051580050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+16:3333:x1872533769956736:12345-0@lo:400: 00000100:00100000:1.0:1785787472.827939:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051580050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+16:3333:x1872533769956736:12345-0@lo:400: Request processed in 34us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787472.827944:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1785787472.827993:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533769956736:0@lo:400: 00000100:00100000:0.0:1785787472.828500:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769957120 00000100:00100000:0.0:1785787472.828505:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769957120 00000100:00100000:0.0:1785787472.828552:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1785787472.828559:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905267d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533769957120:12345-0@lo:400: 00000100:00100000:0.0:1785787472.828596:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905267d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533769957120:12345-0@lo:400: Request processed in 38us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787472.828602:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1785787472.828677:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919077a9b480 x1872533769957120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787472.828685:0:3333:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1785787472.828694:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533769957120:0@lo:400: 00000100:00080000:2.0:1785787472.828742:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785787473.346234:0:6716:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6716:1872533769957376:0@lo:700: 00000100:00100000:2.0:1785787473.346299:0:6716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787473.346351:0:6716:0:(client.c:2702:ptlrpc_set_wait()) set ffff919046ec0180 going to sleep for 11 seconds 00000100:00100000:2.0:1785787473.346372:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785787473.346384:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533769957248:0@lo:13: 00000100:00100000:2.0:1785787473.346410:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787473.346445:0:6621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769957248 00000100:00100000:2.0:1785787473.346452:0:6621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769957248 00000100:00100000:2.0:1785787473.346491:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1785787473.346499:0:6621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533769957248:12345-0@lo:13: 00002000:00000024:2.0:1785787473.346540:0:6621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785787473.346581:0:6621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533769957248:12345-0@lo:13: Request processed in 82us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787473.346600:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1785787473.346643:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919077a9ed80 x1872533769957248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787489 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787473.346659:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533769957248:0@lo:13: 00000100:00100000:0.0:1785787473.355307:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769957376 00000100:00100000:0.0:1785787473.355321:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769957376 00000100:00100000:0.0:1785787473.355378:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1785787473.355388:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6716:x1872533769957376:12345-0@lo:700: 00000100:00100000:0.0:1785787473.355436:0:6625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9b800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6625:1872533769957504:0@lo:700: 00000100:00100000:0.0:1785787473.355500:0:6625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787473.355551:0:6625:0:(client.c:2702:ptlrpc_set_wait()) set ffff919077106b40 going to sleep for 11 seconds 00000100:00100000:2.0:1785787473.356119:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769957504 00000100:00100000:2.0:1785787473.356124:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769957504 00000100:00100000:2.0:1785787473.356160:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1785787473.356168:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6625:x1872533769957504:12345-0@lo:700: 00010000:00010000:0.0:1785787473.410281:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:3.0:1785787473.414563:0:5827:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1785787473.428726:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6625:x1872533769957504:12345-0@lo:700: Request processed in 72552us (73218us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787473.428754:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1785787473.428863:0:6625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919077a9b800 x1872533769957504/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1785787489 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787473.428877:0:6625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9b800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6625:1872533769957504:0@lo:700: 40000000:02000000:3.0:1785787473.428889:0:6625:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:3.0:1785787473.517500:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6716:x1872533769957376:12345-0@lo:700: Request processed in 162105us (171192us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787473.517518:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1785787473.517606:0:6716:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919077a9c380 x1872533769957376/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1785787489 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787473.517621:0:6716:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6716:1872533769957376:0@lo:700: 00000004:02000040:1.0:1785787473.582375:0:6716:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1785787473.586581:0:6716:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6716:1872533769957632:0@lo:5: 00000100:00100000:1.0:1785787473.586644:0:6716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787473.586689:0:6716:0:(client.c:2702:ptlrpc_set_wait()) set ffff919077421540 going to sleep for 11 seconds 00000100:00100000:1.0:1785787473.586716:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769957632 00000100:00100000:1.0:1785787473.586723:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769957632 00000100:00100000:1.0:1785787473.586784:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1785787473.586792:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905267dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6716:x1872533769957632:12345-0@lo:5: 00002000:00080000:1.0:1785787473.595559:0:6619:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1785787473.595577:0:6619:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1785787473.599429:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905267dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6716:x1872533769957632:12345-0@lo:5: Request processed in 12631us (12779us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1785787473.599442:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1785787473.599681:0:6716:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91905267f800 x1872533769957632/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1785787489 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787473.599698:0:6716:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6716:1872533769957632:0@lo:5: 00000004:00080000:0.0:1785787473.599712:0:6716:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00000001:02000400:0.0:1785787474.090202:0:6987:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg353-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1785787474.428120:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787475.447208:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787476.467067:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787477.491187:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785787477.939122:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3333:1872533769958016:0@lo:400: 00000100:00100000:2.0:1785787477.939182:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787477.939235:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785787477.939242:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533769958144:0@lo:400: 00000100:00100000:2.0:1785787477.939270:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787477.939309:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769958016 00000100:00100000:2.0:1785787477.939315:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769958016 00000100:00100000:2.0:1785787477.939363:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1785787477.939372:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1872533769958016:12345-0@lo:400: 00000100:00100000:2.0:1785787477.939420:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1872533769958016:12345-0@lo:400: Request processed in 49us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787477.939427:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1785787477.939447:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1785787477.939468:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919077a9ca80 x1872533769958016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787477.939482:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3333:1872533769958016:0@lo:400: 00000100:00100000:3.0:1785787477.939552:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3336:1872533769957888:0@lo:400: 00000100:00100000:3.0:1785787477.939580:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787477.939607:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785787477.939612:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8642023-9103-4dbf-85d1-f204189bc871:3336:1872533769957760:0@lo:400: 00000100:00100000:3.0:1785787477.939635:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787477.939739:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769957888 00000100:00100000:2.0:1785787477.939754:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769957888 00000100:00100000:2.0:1785787477.939786:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1785787477.939793:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3336:x1872533769957888:12345-0@lo:400: 00000100:00100000:2.0:1785787477.939850:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3336:x1872533769957888:12345-0@lo:400: Request processed in 57us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787477.939857:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1785787477.939883:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919077a9c000 x1872533769957888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787477.939892:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3336:1872533769957888:0@lo:400: 00000100:00100000:0.0:1785787477.941640:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769958144 00000100:00100000:0.0:1785787477.941650:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769958144 00000100:00100000:0.0:1785787477.941726:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1785787477.941734:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3333:x1872533769958144:12345-0@lo:400: 00000100:00100000:0.0:1785787477.941791:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3333:x1872533769958144:12345-0@lo:400: Request processed in 57us (2520us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787477.941798:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1785787477.944059:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1785787477.944116:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919077a9d500 x1872533769958144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787477.944131:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533769958144:0@lo:400: 00000100:00100000:0.0:1785787477.944220:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769957760 00000100:00100000:0.0:1785787477.944227:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769957760 00000100:00100000:0.0:1785787477.944274:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1785787477.944282:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051583c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+16:3336:x1872533769957760:12345-0@lo:400: 00000100:00100000:0.0:1785787477.944351:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051583c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+16:3336:x1872533769957760:12345-0@lo:400: Request processed in 69us (4714us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787477.944365:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1785787477.944455:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8642023-9103-4dbf-85d1-f204189bc871:3336:1872533769957760:0@lo:400: 00000100:00100000:0.0:1785787478.451956:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785787478.451980:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769958272:0@lo:13: 00000100:00100000:0.0:1785787478.452042:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787478.452103:0:6621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769958272 00000100:00100000:0.0:1785787478.452110:0:6621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769958272 00000100:00100000:0.0:1785787478.452150:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1785787478.452158:0:6621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3336:x1872533769958272:12345-0@lo:13: 00002000:00000024:0.0:1785787478.452187:0:6621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785787478.452227:0:6621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3336:x1872533769958272:12345-0@lo:13: Request processed in 69us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787478.452233:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1785787478.452276:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919077a9bb80 x1872533769958272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787494 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787478.452293:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769958272:0@lo:13: 00010000:00010000:3.0:1785787478.516596:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1785787478.589963:0:6642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1785787479.545438:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787480.570053:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787481.587795:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787482.620985:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785787483.059102:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3334:1872533769958656:0@lo:400: 00000100:00100000:2.0:1785787483.059163:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787483.059218:0:3334:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785787483.059224:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533769958528:0@lo:400: 00000100:00100000:2.0:1785787483.059243:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787483.059272:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769958656 00000100:00100000:2.0:1785787483.059278:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769958656 00000100:00100000:2.0:1785787483.059321:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769958528 00000100:00100000:2.0:1785787483.059324:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769958528 00000100:00100000:2.0:1785787483.059350:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1785787483.059358:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3334:x1872533769958656:12345-0@lo:400: 00000100:00100000:2.0:1785787483.059401:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3334:x1872533769958656:12345-0@lo:400: Request processed in 43us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787483.059419:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1785787483.059436:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1785787483.059442:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533769958528:12345-0@lo:400: 00000100:00100000:2.0:1785787483.059472:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533769958528:12345-0@lo:400: Request processed in 29us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787483.059478:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1785787483.059496:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1785787483.059518:0:3334:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919077a9c000 x1872533769958528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787499 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787483.059532:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533769958528:0@lo:400: 00010000:00080000:2.0:1785787483.059541:0:3334:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919077a9ca80 x1872533769958656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787499 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787483.059549:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3334:1872533769958656:0@lo:400: 00000100:00100000:0.0:1785787483.059709:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8642023-9103-4dbf-85d1-f204189bc871:3336:1872533769958400:0@lo:400: 00000100:00100000:0.0:1785787483.059740:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787483.059778:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785787483.059784:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769958784:0@lo:400: 00000100:00100000:0.0:1785787483.059808:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787483.060011:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769958784 00000100:00100000:1.0:1785787483.060016:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769958784 00000100:00100000:1.0:1785787483.060058:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1785787483.060065:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769958784:12345-0@lo:400: 00000100:00100000:1.0:1785787483.060101:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769958784:12345-0@lo:400: Request processed in 37us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787483.060107:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1785787483.060129:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919077a9c700 x1872533769958784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787499 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787483.060138:0:3336:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1785787483.060147:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769958784:0@lo:400: 00000100:00080000:0.0:1785787483.060202:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785787483.060243:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769958400 00000100:00100000:2.0:1785787483.060247:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769958400 00000100:00100000:2.0:1785787483.060275:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1785787483.060281:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051582c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+16:3336:x1872533769958400:12345-0@lo:400: 00000100:00100000:2.0:1785787483.060319:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051582c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+16:3336:x1872533769958400:12345-0@lo:400: Request processed in 38us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787483.060332:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1785787483.060467:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8642023-9103-4dbf-85d1-f204189bc871:3336:1872533769958400:0@lo:400: 00000100:00100000:3.0:1785787483.576860:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769958912:0@lo:13: 00000100:00100000:3.0:1785787483.576949:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787483.580397:0:6621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769958912 00000100:00100000:2.0:1785787483.580409:0:6621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769958912 00000100:00100000:2.0:1785787483.580464:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1785787483.580474:0:6621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b374e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769958912:12345-0@lo:13: 00002000:00000024:2.0:1785787483.580506:0:6621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785787483.592759:0:6621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b374e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769958912:12345-0@lo:13: Request processed in 12268us (15792us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787483.592774:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1785787483.593266:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919077a9ca80 x1872533769958912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787499 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787483.593290:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769958912:0@lo:13: 00010000:00010000:0.0:1785787483.638698:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787484.660947:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787485.684936:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787486.707333:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787487.732221:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785787488.179925:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533769959296:0@lo:400: 00000100:00100000:1.0:1785787488.179998:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787488.180051:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785787488.180057:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769959424:0@lo:400: 00000100:00100000:1.0:1785787488.180084:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787488.180119:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769959424 00000100:00100000:1.0:1785787488.180126:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769959424 00000100:00100000:1.0:1785787488.180270:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1785787488.180280:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905267ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769959424:12345-0@lo:400: 00000100:00100000:1.0:1785787488.180329:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905267ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769959424:12345-0@lo:400: Request processed in 51us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787488.180335:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1785787488.180379:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91905267c380 x1872533769959424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787504 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787488.180411:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769959424:0@lo:400: 00000100:00100000:2.0:1785787488.180495:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533769959040:0@lo:400: 00000100:00100000:2.0:1785787488.180535:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787488.180571:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785787488.180578:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1872533769959168:0@lo:400: 00000100:00100000:2.0:1785787488.180618:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787488.180651:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769959296 00000100:00100000:2.0:1785787488.180655:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769959296 00000100:00100000:2.0:1785787488.180682:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769959168 00000100:00100000:2.0:1785787488.180684:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769959168 00000100:00100000:2.0:1785787488.180697:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1785787488.180703:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905267fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533769959296:12345-0@lo:400: 00000100:00100000:2.0:1785787488.180878:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905267fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533769959296:12345-0@lo:400: Request processed in 174us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787488.180884:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1785787488.180899:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1785787488.180904:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1872533769959168:12345-0@lo:400: 00000100:00100000:2.0:1785787488.180936:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1872533769959168:12345-0@lo:400: Request processed in 32us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787488.180941:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1785787488.180967:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91905267f480 x1872533769959168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787504 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787488.180976:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1872533769959168:0@lo:400: 00010000:00080000:2.0:1785787488.181051:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91905267ed80 x1872533769959296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787504 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787488.181071:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533769959296:0@lo:400: 00000100:00100000:1.0:1785787488.181144:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769959040 00000100:00100000:1.0:1785787488.181148:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769959040 00000100:00080000:0.0:1785787488.181888:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785787488.181893:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785787488.182075:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1785787488.182085:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051581850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+16:3333:x1872533769959040:12345-0@lo:400: 00000100:00100000:1.0:1785787488.182130:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051581850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+16:3333:x1872533769959040:12345-0@lo:400: Request processed in 47us (1594us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787488.182136:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1785787488.183280:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533769959040:0@lo:400: 00000100:00100000:2.0:1785787488.691538:0:3334:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785787488.691562:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533769959552:0@lo:13: 00000100:00100000:2.0:1785787488.691623:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787488.702921:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769959552 00000100:00100000:1.0:1785787488.702933:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769959552 00000100:00100000:1.0:1785787488.702997:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1785787488.703008:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533769959552:12345-0@lo:13: 00002000:00000024:1.0:1785787488.703042:0:6620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785787488.703122:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533769959552:12345-0@lo:13: Request processed in 116us (11498us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787488.703129:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1785787488.703408:0:3334:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919077a9e680 x1872533769959552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787504 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787488.703428:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533769959552:0@lo:13: 00010000:00010000:3.0:1785787488.755431:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1785787488.912470:0:7505:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1785787488.912474:0:7505:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1785787488.912600:0:7505:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff91907fddf800 00000020:01000004:2.0:1785787488.912615:0:7505:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1785787488.912627:0:7505:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1785787488.912638:0:7505:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff91905c493380) 00000020:00000080:2.0:1785787488.912653:0:7505:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1785787488.956591:0:7505:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1785787488.962774:0:7505:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1785787489.013543:0:7505:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1785787489.019047:0:7505:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1785787489.019077:0:7505:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1785787489.019131:0:7505:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1785787489.019156:0:7505:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1785787489.019459:0:7505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1785787489.019470:0:7505:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1785787489.019480:0:7505:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe2c2ff68a6e84343 00000020:01000004:3.0:1785787489.019486:0:7505:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1785787489.019505:0:7505:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.153@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1785787489.019508:0:7505:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1785787489.019513:0:7505:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1785787489.019530:0:7505:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1785787489.019534:0:7505:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.153@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1785787489.073876:0:7505:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.153@tcp ctxt 0 is initialized 00000020:01000004:2.0:1785787489.073915:0:7505:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.153@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1785787489.073920:0:7505:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1785787489.073921:0:7505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1785787489.073922:0:7505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1785787489.073923:0:7505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1785787489.073924:0:7505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1785787489.073925:0:7505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1785787489.073927:0:7505:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1785787489.073928:0:7505:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1785787489.073929:0:7505:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1785787489.073931:0:7505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1785787489.073932:0:7505:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1785787489.073936:0:7505:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1785787489.073939:0:7505:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1785787489.073940:0:7505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1785787489.073941:0:7505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1785787489.073942:0:7505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1785787489.073948:0:7505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1785787489.073949:0:7505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1785787489.073950:0:7505:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1785787489.073951:0:7505:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1785787489.073951:0:7505:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1785787489.073952:0:7505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1785787489.073953:0:7505:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1785787489.073980:0:7505:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1785787489.073997:0:7505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:7505:1872533769959680:0@lo:253: 00000100:00100000:2.0:1785787489.074069:0:7505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787489.074181:0:7505:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905067b000 going to sleep for 11 seconds 00000100:00100000:0.0:1785787489.078778:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769959680 00000100:00100000:0.0:1785787489.078792:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769959680 00000100:00100000:1.0:1785787489.078916:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1785787489.078926:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051582450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+16:7505:x1872533769959680:12345-0@lo:253: 20000000:01000000:1.0:1785787489.078986:0:5812:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1785787489.078990:0:5812:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1785787489.078994:0:5812:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1785787489.078997:0:5812:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1785787489.080689:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1785787489.081593:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1785787489.081606:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1785787489.081646:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1785787489.081662:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1785787489.081698:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1785787489.082421:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1785787489.083235:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1785787489.083409:0:5812:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.153@tcp 20000000:01000000:1.0:1785787489.083411:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.153@tcp (null) (null) (null) 00000040:00080000:1.0:1785787489.083453:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1785787489.083462:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1785787489.083511:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1785787489.083519:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.153@tcp (null) (null) 00000040:00080000:1.0:1785787489.083551:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1785787489.083559:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1785787489.083588:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1785787489.083636:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1785787489.090277:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1785787489.090303:0:5812:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.153@tcp 20000000:01000000:1.0:1785787489.090306:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.153@tcp (null) (null) (null) 00000040:00080000:1.0:1785787489.090341:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1785787489.090359:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1785787489.090390:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1785787489.090397:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.153@tcp (null) (null) 00000040:00080000:1.0:1785787489.090442:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1785787489.090451:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1785787489.090492:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1785787489.090525:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1785787489.090539:0:5812:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1785787489.090542:0:5812:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1785787489.090546:0:5812:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1785787489.090556:0:5812:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1785787489.090559:0:5812:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1785787489.090590:0:5812:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1785787489.090592:0:5812:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1785787489.091151:0:7507:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1785787489.091195:0:7507:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1785787489.091247:0:7507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1785787489.091637:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1785787489.091686:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1785787489.091718:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1785787489.091728:0:5812:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1785787489.091730:0:5812:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1785787489.092188:0:7508:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1785787489.092228:0:7508:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1785787489.092276:0:7508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1785787489.092456:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1785787489.092486:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1785787489.092546:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1785787489.092557:0:5812:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1785787489.092560:0:5812:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1785787489.092958:0:7509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1785787489.093161:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1785787489.093198:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1785787489.093246:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1785787489.093256:0:5812:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1785787489.093258:0:5812:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1785787489.095950:0:7510:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1785787489.096030:0:7510:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1785787489.096062:0:7510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1785787489.096346:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1785787489.096384:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1785787489.096443:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1785787489.096457:0:5812:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1785787489.096460:0:5812:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1785787489.096468:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1785787489.096485:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff919043c0ea00/0xe2c2ff68a6e8434a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787489.096500:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919043c0f800/0xe2c2ff68a6e8429b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e84294 expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787489.096509:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9190413a1e00/0xe2c2ff68a6e842c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e842be expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787489.096516:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919040030400/0xe2c2ff68a6e842ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e842e8 expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787489.096536:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91908206bc00/0xe2c2ff68a6e8430b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e84304 expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787489.096544:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919043c0fa00/0xe2c2ff68a6e84335 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e8432e expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787489.096552:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff919043c0ea00/0xe2c2ff68a6e8434a lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787489.096585:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919043c0fa00/0xe2c2ff68a6e84335 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2c2ff68a6e8432e expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787489.096599:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919043c0fa00/0xe2c2ff68a6e84335 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2c2ff68a6e8432e expref: 16 pid: 5812 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787489.096612:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5812:1872533769959808:0@lo:104: 00000100:00100000:1.0:1785787489.096681:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1785787489.096728:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91908206bc00/0xe2c2ff68a6e8430b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2c2ff68a6e84304 expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787489.096736:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91908206bc00/0xe2c2ff68a6e8430b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2c2ff68a6e84304 expref: 16 pid: 5812 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787489.096745:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5812:1872533769959936:0@lo:104: 00010000:00010000:1.0:1785787489.096769:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919040030400/0xe2c2ff68a6e842ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2c2ff68a6e842e8 expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787489.096777:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919040030400/0xe2c2ff68a6e842ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2c2ff68a6e842e8 expref: 16 pid: 5813 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787489.096796:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5812:1872533769960064:0@lo:104: 00010000:00010000:1.0:1785787489.096819:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9190413a1e00/0xe2c2ff68a6e842c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2c2ff68a6e842be expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787489.096956:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9190413a1e00/0xe2c2ff68a6e842c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2c2ff68a6e842be expref: 16 pid: 5813 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787489.096967:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5812:1872533769960192:0@lo:104: 00010000:00010000:1.0:1785787489.096999:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919043c0f800/0xe2c2ff68a6e8429b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2c2ff68a6e84294 expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787489.097007:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919043c0f800/0xe2c2ff68a6e8429b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2c2ff68a6e84294 expref: 16 pid: 5813 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787489.097015:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5812:1872533769960320:0@lo:104: 00000100:00100000:1.0:1785787489.097031:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set ffff918f42eeea80 going to sleep for 11 seconds 00000100:00100000:3.0:1785787489.097094:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1785787489.097111:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787489.097133:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787489.097141:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787489.097149:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787489.097158:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769959808 00000100:00100000:3.0:1785787489.097168:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769959808 00000100:00100000:3.0:1785787489.097198:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769959936 00000100:00100000:3.0:1785787489.097201:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769959936 00000100:00100000:3.0:1785787489.097210:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769960064 00000100:00100000:3.0:1785787489.097212:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769960064 00000100:00100000:3.0:1785787489.097219:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769960192 00000100:00100000:3.0:1785787489.097221:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769960192 00000100:00100000:3.0:1785787489.097228:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769960320 00000100:00100000:3.0:1785787489.097230:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769960320 00000100:00100000:3.0:1785787489.097240:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1785787489.097247:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190506c3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8642023-9103-4dbf-85d1-f204189bc871+7:5812:x1872533769959808:12345-0@lo:104: 00010000:00010000:3.0:1785787489.097259:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff919043c0e600/0xe2c2ff68a6e8432e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e84335 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.097313:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1785787489.097319:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190506c3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8642023-9103-4dbf-85d1-f204189bc871+7:5812:x1872533769959808:12345-0@lo:104: Request processed in 72us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787489.097326:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1785787489.097357:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1785787489.097363:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b376300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8642023-9103-4dbf-85d1-f204189bc871+6:5812:x1872533769959936:12345-0@lo:104: 00010000:00010000:3.0:1785787489.097370:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff91908206a400/0xe2c2ff68a6e84304 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e8430b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.097401:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1785787489.097406:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b376300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8642023-9103-4dbf-85d1-f204189bc871+6:5812:x1872533769959936:12345-0@lo:104: Request processed in 44us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787489.097411:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1785787489.097422:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1785787489.097428:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b375180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8642023-9103-4dbf-85d1-f204189bc871+5:5812:x1872533769960064:12345-0@lo:104: 00010000:00010000:3.0:1785787489.097446:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff9190413a1000/0xe2c2ff68a6e842e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e842ef expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.097471:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1785787489.097475:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b375180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8642023-9103-4dbf-85d1-f204189bc871+5:5812:x1872533769960064:12345-0@lo:104: Request processed in 48us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787489.097481:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1785787489.097491:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1785787489.097496:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b376d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8642023-9103-4dbf-85d1-f204189bc871+4:5812:x1872533769960192:12345-0@lo:104: 00010000:00010000:3.0:1785787489.097502:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff91908206a000/0xe2c2ff68a6e842be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e842c5 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.097525:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1785787489.097529:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b376d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8642023-9103-4dbf-85d1-f204189bc871+4:5812:x1872533769960192:12345-0@lo:104: Request processed in 33us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787489.097535:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1785787489.097544:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1785787489.097549:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b374700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8642023-9103-4dbf-85d1-f204189bc871+3:5812:x1872533769960320:12345-0@lo:104: 00010000:00010000:3.0:1785787489.097556:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff919043c0f400/0xe2c2ff68a6e84294 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e8429b expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.097575:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1785787489.097579:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b374700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8642023-9103-4dbf-85d1-f204189bc871+3:5812:x1872533769960320:12345-0@lo:104: Request processed in 31us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787489.097584:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1785787489.097596:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1785787489.097601:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff919043c0e600/0xe2c2ff68a6e8432e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e84335 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.097613:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0e600 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:3.0:1785787489.097617:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff919043c0e600/0xe2c2ff68a6e8432e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2c2ff68a6e84335 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.097626:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff919043c0e600/0xe2c2ff68a6e8432e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2c2ff68a6e84335 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785787489.097633:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff919043c0e600/0xe2c2ff68a6e8432e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2c2ff68a6e84335 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785787489.097638:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1785787489.097673:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff919043c0e600/0xe2c2ff68a6e8432e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e84335 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.097680:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785787489.097692:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff919043c0e600/0xe2c2ff68a6e8432e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e84335 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.097699:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff919043c0e600/0xe2c2ff68a6e8432e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e84335 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.097711:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1785787489.097714:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff91908206a400/0xe2c2ff68a6e84304 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e8430b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.097719:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91908206a400 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:3.0:1785787489.097721:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff91908206a400/0xe2c2ff68a6e84304 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2c2ff68a6e8430b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.097737:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff91908206a400/0xe2c2ff68a6e84304 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2c2ff68a6e8430b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785787489.097743:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff91908206a400/0xe2c2ff68a6e84304 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2c2ff68a6e8430b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785787489.097749:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1785787489.097762:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff91908206a400/0xe2c2ff68a6e84304 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e8430b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.097768:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785787489.097782:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff91908206a400/0xe2c2ff68a6e84304 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e8430b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.097789:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff91908206a400/0xe2c2ff68a6e84304 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e8430b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.097800:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1785787489.097803:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff9190413a1000/0xe2c2ff68a6e842e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e842ef expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.097809:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413a1000 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:3.0:1785787489.097812:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff9190413a1000/0xe2c2ff68a6e842e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2c2ff68a6e842ef expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.097819:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff9190413a1000/0xe2c2ff68a6e842e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2c2ff68a6e842ef expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785787489.097851:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff9190413a1000/0xe2c2ff68a6e842e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2c2ff68a6e842ef expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785787489.097863:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1785787489.097876:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff9190413a1000/0xe2c2ff68a6e842e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e842ef expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.097882:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785787489.097887:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff9190413a1000/0xe2c2ff68a6e842e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e842ef expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.097894:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff9190413a1000/0xe2c2ff68a6e842e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e842ef expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.097904:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1785787489.097907:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff91908206a000/0xe2c2ff68a6e842be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e842c5 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.097912:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91908206a000 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:3.0:1785787489.097915:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff91908206a000/0xe2c2ff68a6e842be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2c2ff68a6e842c5 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.097922:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff91908206a000/0xe2c2ff68a6e842be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2c2ff68a6e842c5 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785787489.097929:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff91908206a000/0xe2c2ff68a6e842be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2c2ff68a6e842c5 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785787489.097935:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1785787489.097944:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff91908206a000/0xe2c2ff68a6e842be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e842c5 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.097950:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785787489.097960:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff91908206a000/0xe2c2ff68a6e842be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e842c5 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.097966:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff91908206a000/0xe2c2ff68a6e842be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e842c5 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.097974:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785787489.097977:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff919043c0f400/0xe2c2ff68a6e84294 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e8429b expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.097982:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0f400 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:3.0:1785787489.097985:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff919043c0f400/0xe2c2ff68a6e84294 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2c2ff68a6e8429b expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.097991:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff919043c0f400/0xe2c2ff68a6e84294 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2c2ff68a6e8429b expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785787489.097997:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff919043c0f400/0xe2c2ff68a6e84294 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2c2ff68a6e8429b expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785787489.098002:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1785787489.098013:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff919043c0f400/0xe2c2ff68a6e84294 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e8429b expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.098019:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785787489.098022:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff919043c0f400/0xe2c2ff68a6e84294 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e8429b expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.098028:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff919043c0f400/0xe2c2ff68a6e84294 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e8429b expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.098039:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787489.098045:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787489.098047:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787489.098068:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533769960448:0@lo:103: 00000100:00100000:3.0:1785787489.098092:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787489.098109:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b377b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533769960960:0@lo:103: 00000100:00100000:3.0:1785787489.098125:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787489.098142:0:3334:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785787489.098147:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533769960832:0@lo:103: 00000100:00100000:3.0:1785787489.098166:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787489.098190:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8642023-9103-4dbf-85d1-f204189bc871:3335:1872533769960576:0@lo:103: 00000100:00100000:3.0:1785787489.098219:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787489.098230:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785787489.098235:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8642023-9103-4dbf-85d1-f204189bc871:3335:1872533769960704:0@lo:103: 00000100:00100000:3.0:1785787489.098249:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787489.098270:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769960448 00000100:00100000:3.0:1785787489.098274:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769960448 00010000:00010000:3.0:1785787489.098290:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919043c0fa00/0xe2c2ff68a6e84335 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e8432e expref: 17 pid: 5812 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787489.098303:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769960960 00000100:00100000:3.0:1785787489.098306:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769960960 00010000:00010000:3.0:1785787489.098315:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919043c0f800/0xe2c2ff68a6e8429b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e84294 expref: 18 pid: 5813 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787489.098324:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769960832 00000100:00100000:3.0:1785787489.098327:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769960832 00010000:00010000:3.0:1785787489.098342:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9190413a1e00/0xe2c2ff68a6e842c5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e842be expref: 19 pid: 5813 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787489.098353:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769960576 00000100:00100000:3.0:1785787489.098361:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769960576 00010000:00010000:3.0:1785787489.098374:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91908206bc00/0xe2c2ff68a6e8430b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e84304 expref: 20 pid: 5812 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787489.098385:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769960704 00000100:00100000:3.0:1785787489.098387:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769960704 00010000:00010000:3.0:1785787489.098396:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919040030400/0xe2c2ff68a6e842ef lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e842e8 expref: 21 pid: 5813 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787489.098408:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1785787489.098414:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b374a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8642023-9103-4dbf-85d1-f204189bc871+21:3334:x1872533769960448:12345-0@lo:103: 00010000:00010000:3.0:1785787489.098423:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787489.098427:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919043c0fa00/0xe2c2ff68a6e84335 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e8432e expref: 21 pid: 5812 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.098438:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919043c0fa00/0xe2c2ff68a6e84335 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2c2ff68a6e8432e expref: 21 pid: 5812 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.098451:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787489.098476:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b374a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8642023-9103-4dbf-85d1-f204189bc871+21:3334:x1872533769960448:12345-0@lo:103: Request processed in 63us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787489.098483:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1785787489.098493:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1785787489.098499:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b374000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8642023-9103-4dbf-85d1-f204189bc871+20:3334:x1872533769960960:12345-0@lo:103: 00010000:00010000:3.0:1785787489.098505:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787489.098510:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919043c0f800/0xe2c2ff68a6e8429b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e84294 expref: 20 pid: 5813 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.098518:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919043c0f800/0xe2c2ff68a6e8429b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2c2ff68a6e84294 expref: 20 pid: 5813 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.098537:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787489.098556:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b374000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8642023-9103-4dbf-85d1-f204189bc871+20:3334:x1872533769960960:12345-0@lo:103: Request processed in 58us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787489.098562:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1785787489.098572:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1785787489.098577:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b375500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8642023-9103-4dbf-85d1-f204189bc871+19:3334:x1872533769960832:12345-0@lo:103: 00010000:00010000:3.0:1785787489.098584:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787489.098588:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9190413a1e00/0xe2c2ff68a6e842c5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e842be expref: 19 pid: 5813 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.098596:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9190413a1e00/0xe2c2ff68a6e842c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2c2ff68a6e842be expref: 19 pid: 5813 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.098605:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787489.098620:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b375500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8642023-9103-4dbf-85d1-f204189bc871+19:3334:x1872533769960832:12345-0@lo:103: Request processed in 43us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787489.098625:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1785787489.098634:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1785787489.098639:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907708a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8642023-9103-4dbf-85d1-f204189bc871+18:3335:x1872533769960576:12345-0@lo:103: 00010000:00010000:3.0:1785787489.098645:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787489.098649:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91908206bc00/0xe2c2ff68a6e8430b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e84304 expref: 18 pid: 5812 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.098657:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91908206bc00/0xe2c2ff68a6e8430b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2c2ff68a6e84304 expref: 18 pid: 5812 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.098666:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787489.098685:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907708a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8642023-9103-4dbf-85d1-f204189bc871+18:3335:x1872533769960576:12345-0@lo:103: Request processed in 46us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787489.098695:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1785787489.098706:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1785787489.098712:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077088e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8642023-9103-4dbf-85d1-f204189bc871+17:3335:x1872533769960704:12345-0@lo:103: 00010000:00010000:3.0:1785787489.098718:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787489.098722:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919040030400/0xe2c2ff68a6e842ef lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e842e8 expref: 17 pid: 5813 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.098730:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919040030400/0xe2c2ff68a6e842ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2c2ff68a6e842e8 expref: 17 pid: 5813 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.098740:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff919043c0ea00/0xe2c2ff68a6e8434a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.098748:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919043c0ea00/0xe2c2ff68a6e8434a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.098760:0:5805:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919043c0ea00/0xe2c2ff68a6e8434a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.098766:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919043c0ea00/0xe2c2ff68a6e8434a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.098772:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff919043c0ea00/0xe2c2ff68a6e8434a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.098777:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff919043c0ea00/0xe2c2ff68a6e8434a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.098782:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0ea00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:3.0:1785787489.098786:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff919043c0ea00/0xe2c2ff68a6e8434a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.098799:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff919043c0ea00/0xe2c2ff68a6e8434a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.098808:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff919043c0ea00/0xe2c2ff68a6e8434a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.098817:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787489.098865:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077088e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8642023-9103-4dbf-85d1-f204189bc871+17:3335:x1872533769960704:12345-0@lo:103: Request processed in 153us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787489.098871:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1785787489.098903:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8642023-9103-4dbf-85d1-f204189bc871:3335:1872533769960704:0@lo:103: 00000100:00100000:3.0:1785787489.098909:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8642023-9103-4dbf-85d1-f204189bc871:3335:1872533769960576:0@lo:103: 00000100:00100000:3.0:1785787489.098926:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533769960832:0@lo:103: 00000100:00100000:3.0:1785787489.098932:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533769960448:0@lo:103: 00000100:00100000:3.0:1785787489.098938:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b377b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533769960960:0@lo:103: 00010000:00010000:1.0:1785787489.100102:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919043c0fa00/0xe2c2ff68a6e84335 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2c2ff68a6e8432e expref: 16 pid: 5812 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787489.100115:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5812:1872533769959808:0@lo:104: 00010000:00010000:1.0:1785787489.100124:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91908206bc00/0xe2c2ff68a6e8430b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2c2ff68a6e84304 expref: 15 pid: 5812 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787489.100133:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5812:1872533769959936:0@lo:104: 00010000:00010000:1.0:1785787489.100141:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919040030400/0xe2c2ff68a6e842ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2c2ff68a6e842e8 expref: 14 pid: 5813 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787489.100163:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5812:1872533769960064:0@lo:104: 00010000:00010000:1.0:1785787489.100175:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9190413a1e00/0xe2c2ff68a6e842c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2c2ff68a6e842be expref: 13 pid: 5813 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787489.100185:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5812:1872533769960192:0@lo:104: 00010000:00010000:1.0:1785787489.100193:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919043c0f800/0xe2c2ff68a6e8429b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2c2ff68a6e84294 expref: 12 pid: 5813 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787489.100200:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5812:1872533769960320:0@lo:104: 00010000:00010000:1.0:1785787489.100218:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff919043c0ea00/0xe2c2ff68a6e8434a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787489.100227:0:5812:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff919043c0ea00/0xe2c2ff68a6e8434a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787489.100234:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff919043c0ea00/0xe2c2ff68a6e8434a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787489.100240:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919043c0ea00/0xe2c2ff68a6e8434a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1785787489.100250:0:5812:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:2.0:1785787489.100371:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785787489.229330:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051582450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+11:7505:x1872533769959680:12345-0@lo:253: Request processed in 150399us (155254us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787489.229344:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1785787489.229465:0:7505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:7505:1872533769959680:0@lo:253: 10000000:01000000:2.0:1785787489.229478:0:7505:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1785787489.229481:0:7505:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1785787489.229483:0:7505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1785787489.229484:0:7505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1785787489.229485:0:7505:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1785787489.229487:0:7505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1785787489.229488:0:7505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1785787489.229489:0:7505:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1785787489.229491:0:7505:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1785787489.229492:0:7505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1785787489.229493:0:7505:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1785787489.229509:0:7505:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91907fddf800 from lustre-OST0001 10000000:01000000:2.0:1785787489.229541:0:7505:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1785787489.229544:0:7505:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1785787489.229551:0:7505:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9190515cb380 local copy 10000000:01000000:2.0:1785787489.229554:0:7505:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1785787489.229585:0:7505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff9190413a0600/0xe2c2ff68a6e84351 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787489.229596:0:7505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.153@tcp lock: ffff9190413a0600/0xe2c2ff68a6e84351 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787489.229606:0:7505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff9190413a0600/0xe2c2ff68a6e84351 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787489.229621:0:7505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:7505:1872533769961088:0@lo:101: 00000100:00100000:2.0:1785787489.229663:0:7505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787489.229713:0:7505:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905067b840 going to sleep for 11 seconds 00000100:00100000:1.0:1785787489.229868:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769961088 00000100:00100000:1.0:1785787489.229874:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769961088 00000100:00100000:1.0:1785787489.229901:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1785787489.229915:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051580c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+11:7505:x1872533769961088:12345-0@lo:101: 00010000:00010000:1.0:1785787489.229927:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787489.229939:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919043c0ea00/0xe2c2ff68a6e84358 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e84351 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787489.229959:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919043c0ea00/0xe2c2ff68a6e84358 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e84351 expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787489.229969:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919043c0ea00/0xe2c2ff68a6e84358 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e84351 expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787489.230042:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919043c0ea00, rc 0) 00000100:00100000:1.0:1785787489.230071:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051580c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+12:7505:x1872533769961088:12345-0@lo:101: Request processed in 157us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787489.230077:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1785787489.230151:0:7505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:7505:1872533769961088:0@lo:101: 00010000:00010000:2.0:1785787489.230163:0:7505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff9190413a0600/0xe2c2ff68a6e84351 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xe2c2ff68a6e84358 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787489.230172:0:7505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff9190413a0600/0xe2c2ff68a6e84351 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe2c2ff68a6e84358 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787489.230261:0:7505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:7505:1872533769961216:0@lo:501: 00000100:00100000:2.0:1785787489.230284:0:7505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787489.230308:0:7505:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905067b840 going to sleep for 11 seconds 00000100:00100000:1.0:1785787489.230356:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769961216 00000100:00100000:1.0:1785787489.230360:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769961216 00000100:00100000:1.0:1785787489.230386:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1785787489.230392:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+12:7505:x1872533769961216:12345-0@lo:501: 00000100:00100000:1.0:1785787489.230539:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+12:7505:x1872533769961216:12345-0@lo:501: Request processed in 146us (253us total) trans 0 rc -2/-2 00000100:00100000:1.0:1785787489.230546:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1785787489.230612:0:7505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:7505:1872533769961216:0@lo:501: 10000000:01000000:2.0:1785787489.230623:0:7505:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1785787489.230697:0:7505:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1785787489.230715:0:7505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff9190413a0600/0xe2c2ff68a6e84351 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe2c2ff68a6e84358 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787489.230725:0:7505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff9190413a0600/0xe2c2ff68a6e84351 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe2c2ff68a6e84358 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787489.230732:0:7505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.153@tcp lock: ffff9190413a0600/0xe2c2ff68a6e84351 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe2c2ff68a6e84358 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787489.230753:0:7505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1785787489.230769:0:7505:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91907fddf800 10000000:01000000:2.0:1785787489.230773:0:7505:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1785787489.230777:0:7505:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1785787489.230780:0:7505:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1785787489.230783:0:7505:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1785787489.230786:0:7505:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1785787489.230798:0:7505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff9190413a0e00/0xe2c2ff68a6e8435f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787489.230806:0:7505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff9190413a0e00/0xe2c2ff68a6e8435f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787489.230814:0:7505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff9190413a0e00/0xe2c2ff68a6e8435f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787489.230825:0:7505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:7505:1872533769961344:0@lo:101: 00000100:00100000:2.0:1785787489.230876:0:7505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787489.230893:0:7505:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905067b180 going to sleep for 11 seconds 00000100:00100000:2.0:1785787489.230905:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769961344 00000100:00100000:2.0:1785787489.230908:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769961344 00000100:00100000:2.0:1785787489.230934:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1785787489.230940:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+12:7505:x1872533769961344:12345-0@lo:101: 00010000:00010000:2.0:1785787489.230946:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787489.230954:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190413a1400/0xe2c2ff68a6e84366 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e8435f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787489.230967:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190413a1400/0xe2c2ff68a6e84366 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e8435f expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787489.231746:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190413a1400/0xe2c2ff68a6e84366 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e8435f expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787489.231754:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190413a1400, rc 0) 00000100:00100000:2.0:1785787489.231789:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+13:7505:x1872533769961344:12345-0@lo:101: Request processed in 849us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787489.231796:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00010000:1.0:1785787489.231877:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785787489.231882:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff9190413a0600/0xe2c2ff68a6e84351 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xe2c2ff68a6e84358 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787489.231889:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413a0600 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:1.0:1785787489.231892:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff9190413a0600/0xe2c2ff68a6e84351 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xe2c2ff68a6e84358 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787489.231912:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff9190413a0600/0xe2c2ff68a6e84351 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xe2c2ff68a6e84358 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785787489.231920:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff9190413a0600/0xe2c2ff68a6e84351 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xe2c2ff68a6e84358 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785787489.231925:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1785787489.231942:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff9190413a0600/0xe2c2ff68a6e84351 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe2c2ff68a6e84358 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787489.231948:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785787489.231960:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff9190413a0600/0xe2c2ff68a6e84351 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe2c2ff68a6e84358 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787489.231966:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff9190413a0600/0xe2c2ff68a6e84351 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe2c2ff68a6e84358 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787489.232032:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787489.232035:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787489.232037:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787489.232180:0:7505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:7505:1872533769961344:0@lo:101: 00010000:00010000:3.0:1785787489.232191:0:7505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff9190413a0e00/0xe2c2ff68a6e8435f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84366 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.232198:0:7505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff9190413a0e00/0xe2c2ff68a6e8435f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e84366 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787489.232254:0:7505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907708a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:7505:1872533769961600:0@lo:501: 00000100:00100000:3.0:1785787489.232279:0:7505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787489.232309:0:7505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190776bdc00 going to sleep for 11 seconds 00000100:00100000:3.0:1785787489.232324:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8642023-9103-4dbf-85d1-f204189bc871:3335:1872533769961472:0@lo:103: 00000100:00100000:3.0:1785787489.232346:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787489.232416:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769961472 00000100:00100000:1.0:1785787489.232420:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769961472 00000100:00100000:1.0:1785787489.232452:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1785787489.232458:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907708b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8642023-9103-4dbf-85d1-f204189bc871+13:3335:x1872533769961472:12345-0@lo:103: 00010000:00010000:1.0:1785787489.232467:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785787489.232477:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919043c0ea00/0xe2c2ff68a6e84358 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2c2ff68a6e84351 expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787489.232487:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785787489.232515:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907708b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8642023-9103-4dbf-85d1-f204189bc871+12:3335:x1872533769961472:12345-0@lo:103: Request processed in 56us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787489.232521:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1785787489.232568:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769961600 00000100:00100000:2.0:1785787489.232572:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769961600 00000100:00100000:2.0:1785787489.232598:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1785787489.232604:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+12:7505:x1872533769961600:12345-0@lo:501: 00000100:00100000:3.0:1785787489.232936:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8642023-9103-4dbf-85d1-f204189bc871:3335:1872533769961472:0@lo:103: 00000100:00100000:2.0:1785787489.233167:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+12:7505:x1872533769961600:12345-0@lo:501: Request processed in 562us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787489.233174:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1785787489.233274:0:7505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907708a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:7505:1872533769961600:0@lo:501: 00000100:00100000:3.0:1785787489.233297:0:7505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907708a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:7505:1872533769961728:0@lo:503: 00000100:00100000:3.0:1785787489.233329:0:7505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787489.233354:0:7505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190776bdc00 going to sleep for 11 seconds 00000100:00100000:1.0:1785787489.233397:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769961728 00000100:00100000:1.0:1785787489.233401:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769961728 00000100:00100000:1.0:1785787489.233424:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1785787489.233430:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+12:7505:x1872533769961728:12345-0@lo:503: 00000100:00100000:1.0:1785787489.233556:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+12:7505:x1872533769961728:12345-0@lo:503: Request processed in 125us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787489.233562:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1785787489.234056:0:7505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907708a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:7505:1872533769961728:0@lo:503: 00000040:00080000:3.0:1785787489.234289:0:7505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1785787489.234341:0:7505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907708a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:7505:1872533769961856:0@lo:502: 00000100:00100000:3.0:1785787489.234377:0:7505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787489.234404:0:7505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190776bdc00 going to sleep for 11 seconds 00000100:00100000:2.0:1785787489.234771:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769961856 00000100:00100000:2.0:1785787489.234776:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769961856 00000100:00100000:2.0:1785787489.234808:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1785787489.234814:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+12:7505:x1872533769961856:12345-0@lo:502: 00000100:00100000:3.0:1785787489.235937:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+12:7505:x1872533769961856:12345-0@lo:502: Request processed in 1121us (1558us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787489.235945:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1785787489.236112:0:7505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907708a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:7505:1872533769961856:0@lo:502: 00000040:00080000:2.0:1785787489.236367:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1785787489.236417:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1785787489.236452:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1785787489.236500:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1785787489.236538:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1785787489.236570:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1785787489.236596:0:7505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:7505:1872533769961984:0@lo:502: 00000100:00100000:2.0:1785787489.236631:0:7505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787489.237297:0:7505:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905067bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1785787489.240881:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769961984 00000100:00100000:1.0:1785787489.240893:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769961984 00000100:00100000:1.0:1785787489.241057:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1785787489.241068:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+12:7505:x1872533769961984:12345-0@lo:502: 00000100:00100000:1.0:1785787489.241302:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+12:7505:x1872533769961984:12345-0@lo:502: Request processed in 236us (4669us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787489.241310:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1785787489.241403:0:7505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:7505:1872533769961984:0@lo:502: 00000040:00080000:3.0:1785787489.241537:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1785787489.241552:0:7505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1785787489.244354:0:7513:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1785787489.244363:0:7513:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1785787489.244370:0:7513:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785787489.244372:0:7513:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1785787489.244377:0:7513:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1785787489.244391:0:7513:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9190507f3380) 00000020:00000080:3.0:1785787489.244411:0:7513:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1785787489.244417:0:7513:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1785787489.244495:0:7513:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91907fddf800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1785787489.244501:0:7513:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1785787489.244508:0:7513:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe2c2ff68a6e84374 00010000:00010000:3.0:1785787489.251261:0:7513:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1785787489.251537:0:7513:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1785787489.257901:0:7513:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1785787489.258162:0:7513:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1785787489.270062:0:7513:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1785787489.270539:0:7513:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1785787489.272506:0:7513:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1785787489.272518:0:7513:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785787489.272524:0:7513:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785787489.272526:0:7513:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1785787489.272530:0:7513:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785787489.272533:0:7513:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785787489.272535:0:7513:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1785787489.272538:0:7513:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1785787489.272540:0:7513:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1785787489.272583:0:7513:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785787489.272586:0:7513:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785787489.272587:0:7513:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1785787489.272590:0:7513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1785787489.274067:0:7505:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1785787489.274097:0:7505:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1785787489.274112:0:7505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff9190413a0e00/0xe2c2ff68a6e8435f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84366 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.274124:0:7505:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff9190413a0e00/0xe2c2ff68a6e8435f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84366 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785787489.274132:0:7505:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff91907fddf800 from 1 10000000:01000000:3.0:1785787489.274135:0:7505:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1785787489.274167:0:7505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e8437b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.274176:0:7505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e8437b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.274185:0:7505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e8437b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787489.274205:0:7505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077089f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:7505:1872533769962112:0@lo:101: 00000100:00100000:3.0:1785787489.274276:0:7505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787489.274317:0:7505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190776bd600 going to sleep for 11 seconds 00000100:00100000:3.0:1785787489.274339:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769962112 00000100:00100000:3.0:1785787489.274345:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769962112 00000100:00100000:3.0:1785787489.274381:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1785787489.274390:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+12:7505:x1872533769962112:12345-0@lo:101: 00010000:00010000:3.0:1785787489.274401:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787489.274413:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91905f902800/0xe2c2ff68a6e84382 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e8437b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.274434:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91905f902800/0xe2c2ff68a6e84382 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e8437b expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.274444:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91905f902800/0xe2c2ff68a6e84382 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e8437b expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.274451:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f902800, rc 0) 00000100:00100000:3.0:1785787489.274487:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+13:7505:x1872533769962112:12345-0@lo:101: Request processed in 98us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787489.274494:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1785787489.274533:0:7505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077089f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:7505:1872533769962112:0@lo:101: 00010000:00010000:3.0:1785787489.274546:0:7505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e8437b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84382 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.274554:0:7505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e8437b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e84382 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787489.274636:0:7505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077089f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:7505:1872533769962240:0@lo:501: 00000100:00100000:3.0:1785787489.274660:0:7505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787489.274682:0:7505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190776bd600 going to sleep for 11 seconds 00000100:00100000:1.0:1785787489.276684:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769962240 00000100:00100000:1.0:1785787489.276692:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769962240 00000100:00100000:1.0:1785787489.276784:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1785787489.276793:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+13:7505:x1872533769962240:12345-0@lo:501: 00000100:00100000:1.0:1785787489.277095:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+13:7505:x1872533769962240:12345-0@lo:501: Request processed in 303us (2434us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787489.277102:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1785787489.277847:0:7505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077089f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:7505:1872533769962240:0@lo:501: 00000100:00100000:3.0:1785787489.277887:0:7505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077089f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:7505:1872533769962368:0@lo:503: 00000100:00100000:3.0:1785787489.277931:0:7505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787489.277953:0:7505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190776bd600 going to sleep for 11 seconds 00000100:00100000:1.0:1785787489.280733:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769962368 00000100:00100000:1.0:1785787489.280746:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769962368 00000100:00100000:1.0:1785787489.280800:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1785787489.280809:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+13:7505:x1872533769962368:12345-0@lo:503: 00000100:00100000:1.0:1785787489.281317:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+13:7505:x1872533769962368:12345-0@lo:503: Request processed in 508us (3385us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787489.281325:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1785787489.281717:0:7505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077089f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:7505:1872533769962368:0@lo:503: 00000040:00080000:3.0:1785787489.282089:0:7505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1785787489.282153:0:7505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077089f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:7505:1872533769962496:0@lo:502: 00000100:00100000:3.0:1785787489.282193:0:7505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787489.282223:0:7505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190776bd600 going to sleep for 11 seconds 00000100:00100000:3.0:1785787489.282241:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769962496 00000100:00100000:3.0:1785787489.282244:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769962496 00000100:00100000:3.0:1785787489.282268:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1785787489.282275:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+13:7505:x1872533769962496:12345-0@lo:502: 00000100:00100000:3.0:1785787489.282431:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+13:7505:x1872533769962496:12345-0@lo:502: Request processed in 155us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787489.282438:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1785787489.282479:0:7505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077089f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:7505:1872533769962496:0@lo:502: 00000040:00080000:3.0:1785787489.285221:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1785787489.285287:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1785787489.285320:0:7505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077089f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:7505:1872533769962624:0@lo:502: 00000100:00100000:3.0:1785787489.285375:0:7505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787489.285404:0:7505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190776bd600 going to sleep for 11 seconds 00000100:00100000:3.0:1785787489.285423:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769962624 00000100:00100000:3.0:1785787489.285429:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769962624 00000100:00100000:3.0:1785787489.285459:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1785787489.285465:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+13:7505:x1872533769962624:12345-0@lo:502: 00000100:00100000:3.0:1785787489.287890:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+13:7505:x1872533769962624:12345-0@lo:502: Request processed in 2418us (2508us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787489.287901:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1785787489.288796:0:7505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077089f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:7505:1872533769962624:0@lo:502: 00000040:00080000:1.0:1785787489.289646:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1785787489.289662:0:7505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1785787489.290425:0:7517:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1785787489.290433:0:7517:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785787489.290435:0:7517:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1785787489.290442:0:7517:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff91907fddf800 00000020:00000080:3.0:1785787489.290444:0:7517:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1785787489.290460:0:7517:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785787489.290463:0:7517:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785787489.290465:0:7517:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1785787489.290468:0:7517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1785787489.290573:0:7505:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1785787489.290647:0:7505:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1785787489.291078:0:7505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e8437b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84382 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787489.291089:0:7505:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e8437b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84382 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785787489.291126:0:7505:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1785787489.291130:0:7505:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91907fddf800 10000000:01000000:1.0:1785787489.291133:0:7505:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91907fddf800 10000000:01000000:1.0:1785787489.291137:0:7505:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1785787489.291141:0:7505:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91907fddf800 from 1 10000000:01000000:1.0:1785787489.291144:0:7505:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1785787489.291175:0:7505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff919043c0ea00/0xe2c2ff68a6e84389 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787489.291184:0:7505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff919043c0ea00/0xe2c2ff68a6e84389 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787489.291194:0:7505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff919043c0ea00/0xe2c2ff68a6e84389 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787489.291211:0:7505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:7505:1872533769962752:0@lo:101: 00000100:00100000:1.0:1785787489.291262:0:7505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787489.291289:0:7505:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905159da80 going to sleep for 11 seconds 00000100:00100000:2.0:1785787489.291932:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769962752 00000100:00100000:2.0:1785787489.291939:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769962752 00000100:00100000:2.0:1785787489.291983:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1785787489.291991:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+13:7505:x1872533769962752:12345-0@lo:101: 00010000:00010000:2.0:1785787489.292003:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787489.292014:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190413a0600/0xe2c2ff68a6e84390 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e84389 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787489.292033:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190413a0600/0xe2c2ff68a6e84390 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e84389 expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787489.292043:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190413a0600/0xe2c2ff68a6e84390 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e84389 expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787489.292052:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190413a0600, rc 0) 00000100:00100000:2.0:1785787489.292093:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+14:7505:x1872533769962752:12345-0@lo:101: Request processed in 103us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787489.292100:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1785787489.294654:0:7505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:7505:1872533769962752:0@lo:101: 00010000:00010000:0.0:1785787489.294675:0:7505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff919043c0ea00/0xe2c2ff68a6e84389 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84390 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787489.294688:0:7505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff919043c0ea00/0xe2c2ff68a6e84389 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e84390 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787489.294801:0:7505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:7505:1872533769962880:0@lo:501: 00000100:00100000:0.0:1785787489.294871:0:7505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787489.294916:0:7505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190507db840 going to sleep for 11 seconds 00000100:00100000:2.0:1785787489.295709:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769962880 00000100:00100000:2.0:1785787489.295715:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769962880 00000100:00100000:2.0:1785787489.295761:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1785787489.295769:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+14:7505:x1872533769962880:12345-0@lo:501: 00000100:00100000:2.0:1785787489.296137:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+14:7505:x1872533769962880:12345-0@lo:501: Request processed in 368us (1265us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787489.296145:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1785787489.296211:0:7505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:7505:1872533769962880:0@lo:501: 00000100:00100000:1.0:1785787489.296239:0:7505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:7505:1872533769963008:0@lo:503: 00000100:00100000:1.0:1785787489.296277:0:7505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787489.296306:0:7505:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905159d000 going to sleep for 11 seconds 00000100:00100000:0.0:1785787489.296370:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769963008 00000100:00100000:0.0:1785787489.296374:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769963008 00000100:00100000:0.0:1785787489.296395:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1785787489.296402:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+14:7505:x1872533769963008:12345-0@lo:503: 00000100:00100000:0.0:1785787489.296525:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+14:7505:x1872533769963008:12345-0@lo:503: Request processed in 123us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787489.296532:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1785787489.296608:0:7505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:7505:1872533769963008:0@lo:503: 00000040:00080000:1.0:1785787489.296859:0:7505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1785787489.296907:0:7505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:7505:1872533769963136:0@lo:502: 00000100:00100000:1.0:1785787489.296939:0:7505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787489.296953:0:7505:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905159d000 going to sleep for 11 seconds 00000100:00100000:0.0:1785787489.297121:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769963136 00000100:00100000:0.0:1785787489.297126:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769963136 00000100:00100000:0.0:1785787489.297143:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1785787489.297149:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+14:7505:x1872533769963136:12345-0@lo:502: 00000100:00100000:0.0:1785787489.297296:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+14:7505:x1872533769963136:12345-0@lo:502: Request processed in 146us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787489.297303:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1785787489.297671:0:7505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:7505:1872533769963136:0@lo:502: 00000040:00080000:1.0:1785787489.297946:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1785787489.298729:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1785787489.298767:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1785787489.298815:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1785787489.298886:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1785787489.298935:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1785787489.298968:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1785787489.299132:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1785787489.299183:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1785787489.299220:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1785787489.299270:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1785787489.299322:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1785787489.299360:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1785787489.299394:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1785787489.299454:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1785787489.299492:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1785787489.299534:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1785787489.299641:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1785787489.299681:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1785787489.299763:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1785787489.299810:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1785787489.300048:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1785787489.300082:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1785787489.300139:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1785787489.300177:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1785787489.300208:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1785787489.300250:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1785787489.300285:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1785787489.300319:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1785787489.300366:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1785787489.300403:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1785787489.300434:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1785787489.300462:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1785787489.300502:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1785787489.300531:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1785787489.300570:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1785787489.301695:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1785787489.301790:0:7505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a99180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:7505:1872533769963264:0@lo:502: 00000100:00100000:0.0:1785787489.302126:0:7505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787489.302195:0:7505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190507db900 going to sleep for 11 seconds 00000100:00100000:2.0:1785787489.304771:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769963264 00000100:00100000:2.0:1785787489.304781:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769963264 00000100:00100000:2.0:1785787489.304902:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1785787489.304911:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+14:7505:x1872533769963264:12345-0@lo:502: 00000100:00100000:2.0:1785787489.306235:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+14:7505:x1872533769963264:12345-0@lo:502: Request processed in 1323us (4106us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787489.306245:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1785787489.306328:0:7505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a99180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:7505:1872533769963264:0@lo:502: 00000040:00080000:0.0:1785787489.306418:0:7505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1785787489.306431:0:7505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1785787489.306954:0:7518:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1785787489.306967:0:7518:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9190515c99c0) 00000020:00000080:0.0:1785787489.306994:0:7518:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1785787489.307122:0:7518:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91907fddf800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1785787489.307130:0:7518:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91907fddf800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1785787489.307133:0:7518:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91907fddf800 3 00010000:00080000:0.0:1785787489.307154:0:7518:0:(ldlm_lib.c:102:import_set_conn()) imp ffff918f41bcd800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.153@tcp at head 00010000:00010000:0.0:1785787489.308496:0:7518:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1785787489.308567:0:7518:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1785787489.308590:0:7518:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1785787489.308597:0:7518:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xe2c2ff68a6e8439e 00000100:00080000:0.0:1785787489.308603:0:7518:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1785787489.308608:0:7518:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff918f41bcd800 using connection 192.168.203.153@tcp/0@lo 00000100:00100000:0.0:1785787489.308633:0:7518:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff919077a99180 x1872533769963392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1785787489.308657:0:7518:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1785787489.308718:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3336:1872533769963520:0@lo:400: 00000100:00100000:0.0:1785787489.308755:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787489.308788:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3333:1872533769963648:0@lo:400: 00000100:00100000:0.0:1785787489.308806:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787489.308820:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785787489.308824:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533769963776:0@lo:400: 00000100:00100000:0.0:1785787489.308872:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787489.308899:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769963776 00000100:00100000:0.0:1785787489.308904:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769963776 00000100:00100000:0.0:1785787489.308938:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1785787489.308946:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533769963776:12345-0@lo:400: 00000100:00100000:0.0:1785787489.308984:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533769963776:12345-0@lo:400: Request processed in 39us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787489.308991:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1785787489.309018:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919077a9a300 x1872533769963776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787489.309035:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533769963776:0@lo:400: 00000100:00100000:3.0:1785787489.313090:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769963520 00000100:00100000:3.0:1785787489.313102:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769963520 00000100:00100000:3.0:1785787489.313148:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769963648 00000100:00100000:3.0:1785787489.313151:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769963648 00000100:00100000:3.0:1785787489.313167:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1785787489.313175:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3336:x1872533769963520:12345-0@lo:400: 00000100:00100000:3.0:1785787489.313249:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3336:x1872533769963520:12345-0@lo:400: Request processed in 75us (4493us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787489.313255:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1785787489.313268:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1785787489.313275:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1872533769963648:12345-0@lo:400: 00000100:00100000:3.0:1785787489.313301:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1872533769963648:12345-0@lo:400: Request processed in 27us (4494us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787489.313306:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1785787489.313326:0:3332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1872533769963392:0@lo:38: 00000100:00100000:3.0:1785787489.313359:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787489.313407:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769963392 00000100:00100000:3.0:1785787489.313411:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769963392 00000100:00100000:3.0:1785787489.313423:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1785787489.313427:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077088700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1872533769963392:12345-0@lo:38: 00010000:00080000:3.0:1785787489.313445:0:5822:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 276 last 0 00000020:00000080:3.0:1785787489.313473:0:5822:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xe2c2ff68a6e843a5 00000004:00100000:3.0:1785787489.313485:0:5822:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1785787489.313509:0:5822:0:(import.c:65:import_set_state_nolock()) ffff919077062800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1785787489.313540:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077088700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3332:x1872533769963392:12345-0@lo:38: Request processed in 111us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787489.313546:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1785787489.313572:0:3332:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919077a99180 x1872533769963392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1785787499 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1785787489.314680:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919077a9b100 x1872533769963520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787489.314693:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3336:1872533769963520:0@lo:400: 00010000:00080000:0.0:1785787489.314786:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919077a99f80 x1872533769963648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787489.314795:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3333:1872533769963648:0@lo:400: 00000100:00100000:3.0:1785787489.315055:0:3332:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1785787489.315063:0:3332:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1785787489.315070:0:3332:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1785787489.315074:0:3332:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1785787489.315076:0:3332:0:(import.c:65:import_set_state_nolock()) ffff918f41bcd800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1785787489.315082:0:3332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1872533769963392:0@lo:38: 00000040:00080000:3.0:1785787489.315349:0:7518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1785787489.316684:0:7505:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1785787489.316723:0:7505:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1785787489.316737:0:7505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff919043c0ea00/0xe2c2ff68a6e84389 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84390 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787489.316747:0:7505:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff919043c0ea00/0xe2c2ff68a6e84389 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84390 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1785787489.316807:0:7505:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1785787489.316809:0:7505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1785787489.316811:0:7505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785787489.316812:0:7505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1785787489.316813:0:7505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785787489.316815:0:7505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785787489.316816:0:7505:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1785787489.316817:0:7505:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1785787489.316824:0:7505:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1785787489.316849:0:7505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785787489.316851:0:7505:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1785787489.316855:0:7505:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1785787489.316857:0:7505:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1785787489.316858:0:7505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1785787489.316859:0:7505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785787489.316860:0:7505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1785787489.316861:0:7505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785787489.316862:0:7505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785787489.316863:0:7505:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1785787489.316864:0:7505:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1785787489.316865:0:7505:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1785787489.316866:0:7505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785787489.316867:0:7505:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1785787489.316886:0:7505:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1785787489.316899:0:7505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:7505:1872533769963904:0@lo:253: 00000100:00100000:1.0:1785787489.316950:0:7505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787489.316992:0:7505:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905159d480 going to sleep for 11 seconds 00000100:00100000:3.0:1785787489.318104:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769963904 00000100:00100000:3.0:1785787489.318111:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769963904 00000100:00100000:3.0:1785787489.318150:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1785787489.318159:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051538c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+14:7505:x1872533769963904:12345-0@lo:253: 20000000:01000000:3.0:1785787489.318194:0:5814:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1785787489.318208:0:5814:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1785787489.326553:0:7519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9d500 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7519:1872533769964032:0@lo:901: 00000100:00100000:2.0:1785787489.326626:0:7519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787489.326659:0:7519:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905067b840 going to sleep for 11 seconds 00000100:00100000:1.0:1785787489.327480:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769964032 00000100:00100000:1.0:1785787489.327487:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769964032 00000100:00100000:1.0:1785787489.327545:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1785787489.327554:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7519:x1872533769964032:12345-0@lo:901: 00000100:00100000:1.0:1785787489.328027:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7519:x1872533769964032:12345-0@lo:901: Request processed in 418us (1345us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787489.328035:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1785787489.328091:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1785787489.328117:0:7519:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919077a9d500 x1872533769964032/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1785787505 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787489.328131:0:7519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9d500 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7519:1872533769964032:0@lo:901: 20000000:01000000:3.0:1785787489.360405:0:5814:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1785787489.360435:0:5814:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1785787489.361587:0:5836:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1785787489.361592:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1785787489.361612:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff919040030e00/0xe2c2ff68a6e843ac lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787489.361628:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91908206ae00/0xe2c2ff68a6e842fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e842f6 expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787489.361637:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff919040030e00/0xe2c2ff68a6e843ac lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787489.361673:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91908206ae00/0xe2c2ff68a6e842fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2c2ff68a6e842f6 expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787489.361687:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91908206ae00/0xe2c2ff68a6e842fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2c2ff68a6e842f6 expref: 14 pid: 5812 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787489.361709:0:5836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a99f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5836:1872533769964160:0@lo:104: 00000100:00100000:0.0:1785787489.361764:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787489.361814:0:5836:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190507dbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1785787489.362059:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769964160 00000100:00100000:3.0:1785787489.362065:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769964160 00000100:00100000:3.0:1785787489.362108:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1785787489.362116:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8642023-9103-4dbf-85d1-f204189bc871+3:5836:x1872533769964160:12345-0@lo:104: 00010000:00010000:3.0:1785787489.362128:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff91908206a200/0xe2c2ff68a6e842f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e842fd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.362184:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1785787489.362190:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8642023-9103-4dbf-85d1-f204189bc871+3:5836:x1872533769964160:12345-0@lo:104: Request processed in 75us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787489.362197:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1785787489.362217:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785787489.362222:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff91908206a200/0xe2c2ff68a6e842f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e842fd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.362229:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91908206a200 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:3.0:1785787489.362232:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff91908206a200/0xe2c2ff68a6e842f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2c2ff68a6e842fd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.362240:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff91908206a200/0xe2c2ff68a6e842f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2c2ff68a6e842fd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785787489.362247:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff91908206a200/0xe2c2ff68a6e842f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2c2ff68a6e842fd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785787489.362252:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1785787489.362277:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff91908206a200/0xe2c2ff68a6e842f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e842fd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.362282:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785787489.362304:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff91908206a200/0xe2c2ff68a6e842f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e842fd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.362310:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff91908206a200/0xe2c2ff68a6e842f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e842fd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.362325:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787489.362327:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787489.362328:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787489.362339:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077089880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8642023-9103-4dbf-85d1-f204189bc871:3335:1872533769964288:0@lo:103: 00000100:00100000:3.0:1785787489.362367:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787489.362402:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769964288 00000100:00100000:3.0:1785787489.362406:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769964288 00010000:00010000:3.0:1785787489.362421:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91908206ae00/0xe2c2ff68a6e842fd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e842f6 expref: 15 pid: 5812 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787489.362440:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1785787489.362445:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051465450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d8642023-9103-4dbf-85d1-f204189bc871+15:3335:x1872533769964288:12345-0@lo:103: 00010000:00010000:3.0:1785787489.362454:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787489.362458:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91908206ae00/0xe2c2ff68a6e842fd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e842f6 expref: 15 pid: 5812 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.362467:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91908206ae00/0xe2c2ff68a6e842fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2c2ff68a6e842f6 expref: 15 pid: 5812 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.362480:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff919040030e00/0xe2c2ff68a6e843ac lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.362488:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919040030e00/0xe2c2ff68a6e843ac lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1785787489.362507:0:5806:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002654693s 00010000:00010000:3.0:1785787489.362511:0:5806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919040030e00/0xe2c2ff68a6e843ac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.362518:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919040030e00/0xe2c2ff68a6e843ac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.362524:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff919040030e00/0xe2c2ff68a6e843ac lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.362529:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff919040030e00/0xe2c2ff68a6e843ac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.362534:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919040030e00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:3.0:1785787489.362538:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff919040030e00/0xe2c2ff68a6e843ac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.362544:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff919040030e00/0xe2c2ff68a6e843ac lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.362551:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff919040030e00/0xe2c2ff68a6e843ac lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787489.362558:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787489.362583:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051465450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d8642023-9103-4dbf-85d1-f204189bc871+15:3335:x1872533769964288:12345-0@lo:103: Request processed in 137us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787489.362589:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1785787489.362638:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077089880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8642023-9103-4dbf-85d1-f204189bc871:3335:1872533769964288:0@lo:103: 00010000:00010000:1.0:1785787489.362713:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91908206ae00/0xe2c2ff68a6e842fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2c2ff68a6e842f6 expref: 14 pid: 5812 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787489.362724:0:5836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a99f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5836:1872533769964160:0@lo:104: 00010000:00010000:1.0:1785787489.362736:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff919040030e00/0xe2c2ff68a6e843ac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787489.362744:0:5836:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff919040030e00/0xe2c2ff68a6e843ac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787489.362757:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff919040030e00/0xe2c2ff68a6e843ac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787489.362764:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919040030e00/0xe2c2ff68a6e843ac lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787489.434256:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051538c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+13:7505:x1872533769963904:12345-0@lo:253: Request processed in 116091us (117298us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787489.434280:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1785787489.434387:0:7505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8642023-9103-4dbf-85d1-f204189bc871:7505:1872533769963904:0@lo:253: 10000000:01000000:1.0:1785787489.434400:0:7505:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1785787489.434403:0:7505:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1785787489.434405:0:7505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1785787489.434406:0:7505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785787489.434407:0:7505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1785787489.434408:0:7505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785787489.434410:0:7505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785787489.434411:0:7505:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1785787489.434413:0:7505:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1785787489.434414:0:7505:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1785787489.434416:0:7505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785787489.434417:0:7505:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1785787489.434430:0:7505:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1785787489.446347:0:7505:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1785787489.446536:0:7505:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1785787489.447888:0:7505:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1785787489.448192:0:7505:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1785787489.448379:0:7505:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1785787489.448619:0:7505:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1785787489.452895:0:7505:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1785787489.779040:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1785787489.820324:0:7505:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1785787489.820334:0:7505:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1785787489.820367:0:7505:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1785787489.820430:0:7505:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.153@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1785787489.820493:0:7505:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1785787489.820524:0:7505:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1785787490.804771:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787491.832115:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787492.862182:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787493.811329:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769964416:0@lo:13: 00000100:00100000:3.0:1785787493.811396:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787493.811536:0:6621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769964416 00000100:00100000:2.0:1785787493.811545:0:6621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769964416 00000100:00100000:2.0:1785787493.811617:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1785787493.811626:0:6621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077089880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769964416:12345-0@lo:13: 00002000:00000024:2.0:1785787493.811661:0:6621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785787493.811720:0:6621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077089880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769964416:12345-0@lo:13: Request processed in 94us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787493.811751:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1785787493.811786:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919077a9d500 x1872533769964416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787509 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787493.811816:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769964416:0@lo:13: 00000100:00080000:0.0:1785787493.812004:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1785787493.874998:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785787494.327131:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533769964544:0@lo:400: 00000100:00100000:1.0:1785787494.327190:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787494.327247:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785787494.327253:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1872533769964672:0@lo:400: 00000100:00100000:1.0:1785787494.327288:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787494.327320:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533769964800:0@lo:400: 00000100:00100000:1.0:1785787494.327348:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787494.327373:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785787494.327378:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3335:1872533769964928:0@lo:400: 00000100:00100000:1.0:1785787494.327400:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787494.327433:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769964544 00000100:00100000:1.0:1785787494.327439:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769964544 00000100:00100000:1.0:1785787494.327512:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1785787494.327520:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+13:3333:x1872533769964544:12345-0@lo:400: 00000100:00100000:1.0:1785787494.327560:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+13:3333:x1872533769964544:12345-0@lo:400: Request processed in 40us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787494.327567:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1785787494.327595:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769964672 00000100:00100000:1.0:1785787494.327598:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769964672 00000100:00100000:1.0:1785787494.327612:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769964800 00000100:00100000:1.0:1785787494.327614:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769964800 00000100:00100000:1.0:1785787494.327632:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769964928 00000100:00100000:1.0:1785787494.327634:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769964928 00000100:00100000:1.0:1785787494.327645:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1785787494.327650:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905267c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1872533769964672:12345-0@lo:400: 00000100:00100000:1.0:1785787494.327676:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905267c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1872533769964672:12345-0@lo:400: Request processed in 26us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787494.327681:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1785787494.327690:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1785787494.327695:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905267f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533769964800:12345-0@lo:400: 00000100:00100000:1.0:1785787494.327717:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905267f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533769964800:12345-0@lo:400: Request processed in 22us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787494.327722:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1785787494.327730:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1785787494.327735:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905267e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3335:x1872533769964928:12345-0@lo:400: 00000100:00100000:1.0:1785787494.327766:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905267e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3335:x1872533769964928:12345-0@lo:400: Request processed in 31us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787494.327772:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1785787494.327793:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1785787494.327864:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91905267d880 x1872533769964928/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787494.327878:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3335:1872533769964928:0@lo:400: 00010000:00080000:1.0:1785787494.327889:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91905267c380 x1872533769964800/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787494.327898:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533769964800:0@lo:400: 00010000:00080000:1.0:1785787494.327935:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91905267c000 x1872533769964672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787494.327944:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1872533769964672:0@lo:400: 00000100:00100000:1.0:1785787494.327971:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533769964544:0@lo:400: 00010000:00010000:1.0:1785787494.903263:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787495.923736:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1785787496.373326:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1785787496.373333:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff919048214000 from 30 10000000:01000000:1.0:1785787496.373338:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1785787496.373376:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff919043c0ee00/0xe2c2ff68a6e843b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787496.373388:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff919043c0ee00/0xe2c2ff68a6e843b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787496.373399:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff919043c0ee00/0xe2c2ff68a6e843b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787496.373432:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769965056:0@lo:101: 00000100:00100000:1.0:1785787496.373493:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787496.373538:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190486129c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785787496.373587:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769965056 00000100:00100000:3.0:1785787496.373593:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769965056 00000100:00100000:3.0:1785787496.373645:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1785787496.373664:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051539c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+13:5818:x1872533769965056:12345-0@lo:101: 00010000:00010000:3.0:1785787496.373676:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787496.373689:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91905f903000/0xe2c2ff68a6e843ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e843b3 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787496.373710:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91905f903000/0xe2c2ff68a6e843ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e843b3 expref: 14 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787496.373934:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91905f903000/0xe2c2ff68a6e843ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e843b3 expref: 14 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787496.373945:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f903000, rc 0) 00000100:00100000:3.0:1785787496.373987:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051539c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+14:5818:x1872533769965056:12345-0@lo:101: Request processed in 334us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787496.373993:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1785787496.376572:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769965056:0@lo:101: 00010000:00010000:2.0:1785787496.376594:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff919043c0ee00/0xe2c2ff68a6e843b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e843ba expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787496.376605:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff919043c0ee00/0xe2c2ff68a6e843b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e843ba expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787496.376825:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769965184:0@lo:501: 00000100:00100000:2.0:1785787496.376894:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787496.376926:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905064a300 going to sleep for 11 seconds 00000100:00100000:1.0:1785787496.376989:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769965184 00000100:00100000:1.0:1785787496.376994:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769965184 00000100:00100000:1.0:1785787496.377035:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1785787496.377043:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051539450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+14:5818:x1872533769965184:12345-0@lo:501: 00000100:00100000:1.0:1785787496.377363:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051539450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+14:5818:x1872533769965184:12345-0@lo:501: Request processed in 319us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787496.377370:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1785787496.377403:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769965184:0@lo:501: 00000100:00100000:1.0:1785787496.377429:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769965312:0@lo:503: 00000100:00100000:1.0:1785787496.377466:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787496.377486:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff919048612000 going to sleep for 11 seconds 00000100:00100000:1.0:1785787496.377498:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769965312 00000100:00100000:1.0:1785787496.377501:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769965312 00000100:00100000:1.0:1785787496.377522:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1785787496.377528:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+14:5818:x1872533769965312:12345-0@lo:503: 00000100:00100000:1.0:1785787496.377974:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+14:5818:x1872533769965312:12345-0@lo:503: Request processed in 445us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787496.377980:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1785787496.378120:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769965312:0@lo:503: 00000100:00100000:0.0:1785787496.378947:0:7820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:7820:1872533769965440:0@lo:502: 00000100:00100000:0.0:1785787496.378986:0:7820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787496.379010:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769965440 00000100:00100000:0.0:1785787496.379014:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769965440 00000100:00100000:0.0:1785787496.379037:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1785787496.379044:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051538850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+14:7820:x1872533769965440:12345-0@lo:502: 00000100:00100000:0.0:1785787496.379237:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051538850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+14:7820:x1872533769965440:12345-0@lo:502: Request processed in 193us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787496.379243:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1785787496.379272:0:7820:0:(client.c:2702:ptlrpc_set_wait()) set ffff91904547e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785787496.379283:0:7820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:7820:1872533769965440:0@lo:502: 00000100:00100000:0.0:1785787496.379316:0:7820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:7820:1872533769965568:0@lo:502: 00000100:00100000:0.0:1785787496.379351:0:7820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787496.379362:0:7820:0:(client.c:2702:ptlrpc_set_wait()) set ffff919042b4b480 going to sleep for 11 seconds 00000100:00100000:1.0:1785787496.379795:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769965568 00000100:00100000:1.0:1785787496.379800:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769965568 00000100:00100000:1.0:1785787496.379822:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1785787496.379843:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051538450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+14:7820:x1872533769965568:12345-0@lo:502: 00000100:00100000:1.0:1785787496.379970:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051538450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+14:7820:x1872533769965568:12345-0@lo:502: Request processed in 142us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787496.379976:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1785787496.380794:0:7820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:7820:1872533769965568:0@lo:502: 00000040:00080000:0.0:1785787496.380815:0:7820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1785787496.381201:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1785787496.381217:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1785787496.381225:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff919043c0ee00/0xe2c2ff68a6e843b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e843ba expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787496.381233:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff919043c0ee00/0xe2c2ff68a6e843b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e843ba expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785787496.381241:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1785787496.381243:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1785787496.381246:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1785787496.381269:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff919043c0ec00/0xe2c2ff68a6e843c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787496.381276:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff919043c0ec00/0xe2c2ff68a6e843c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787496.381283:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff919043c0ec00/0xe2c2ff68a6e843c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787496.381294:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769965696:0@lo:101: 00000100:00100000:1.0:1785787496.381319:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787496.381347:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff919048612180 going to sleep for 11 seconds 00000100:00100000:0.0:1785787496.381386:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769965696 00000100:00100000:0.0:1785787496.381390:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769965696 00000100:00100000:0.0:1785787496.381423:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1785787496.381429:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+14:5818:x1872533769965696:12345-0@lo:101: 00010000:00010000:0.0:1785787496.381437:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787496.381447:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919040031800/0xe2c2ff68a6e843c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e843c1 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787496.381464:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919040031800/0xe2c2ff68a6e843c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e843c1 expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787496.381479:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919040031800/0xe2c2ff68a6e843c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e843c1 expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787496.381486:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919040031800, rc 0) 00000100:00100000:0.0:1785787496.381512:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+15:5818:x1872533769965696:12345-0@lo:101: Request processed in 83us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787496.381517:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1785787496.381540:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769965696:0@lo:101: 00010000:00010000:0.0:1785787496.381549:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff919043c0ec00/0xe2c2ff68a6e843c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e843c8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787496.381557:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff919043c0ec00/0xe2c2ff68a6e843c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e843c8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787496.381599:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769965824:0@lo:501: 00000100:00100000:0.0:1785787496.381621:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787496.381632:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff919042b4bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1785787496.381641:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769965824 00000100:00100000:0.0:1785787496.381644:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769965824 00000100:00100000:0.0:1785787496.381801:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1785787496.381810:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+15:5818:x1872533769965824:12345-0@lo:501: 00000100:00100000:0.0:1785787496.382004:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+15:5818:x1872533769965824:12345-0@lo:501: Request processed in 194us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787496.389176:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1785787496.389263:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769965824:0@lo:501: 00000100:00100000:0.0:1785787496.389316:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769965952:0@lo:503: 00000100:00100000:0.0:1785787496.389379:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787496.389423:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff919042b4bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1785787496.389478:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769965952 00000100:00100000:3.0:1785787496.389485:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769965952 00000100:00100000:3.0:1785787496.389534:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1785787496.389543:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+15:5818:x1872533769965952:12345-0@lo:503: 00000100:00100000:0.0:1785787496.390865:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769965952:0@lo:503: 00000100:00100000:0.0:1785787496.391045:0:7821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:7821:1872533769966080:0@lo:502: 00000100:00100000:0.0:1785787496.391085:0:7821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787496.391107:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769966080 00000100:00100000:0.0:1785787496.391111:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769966080 00000100:00100000:0.0:1785787496.391134:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1785787496.391140:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051539050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+16:7821:x1872533769966080:12345-0@lo:502: 00000100:00100000:0.0:1785787496.391297:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051539050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+16:7821:x1872533769966080:12345-0@lo:502: Request processed in 155us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787496.391305:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1785787496.391343:0:7821:0:(client.c:2702:ptlrpc_set_wait()) set ffff919042b4bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1785787496.391354:0:7821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:7821:1872533769966080:0@lo:502: 00000020:01000000:0.0:1785787496.391372:0:7821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785787496.391379:0:7821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785787496.391381:0:7821:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1785787496.391386:0:7821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1785787496.391388:0:7821:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1785787496.391401:0:7821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:7821:1872533769966208:0@lo:502: 00000100:00100000:0.0:1785787496.391427:0:7821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787496.391443:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769966208 00000100:00100000:0.0:1785787496.391446:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769966208 00000100:00100000:0.0:1785787496.391462:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1785787496.391467:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051538050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+16:7821:x1872533769966208:12345-0@lo:502: 00000100:00100000:0.0:1785787496.391560:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051538050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+16:7821:x1872533769966208:12345-0@lo:502: Request processed in 91us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787496.391566:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1785787496.391591:0:7821:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190515b7600 going to sleep for 11 seconds 00000100:00100000:0.0:1785787496.391602:0:7821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:7821:1872533769966208:0@lo:502: 00000020:01000000:0.0:1785787496.391616:0:7821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785787496.391620:0:7821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785787496.391621:0:7821:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1785787496.391625:0:7821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1785787496.391771:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1785787496.391797:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1785787496.391806:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff919043c0ec00/0xe2c2ff68a6e843c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e843c8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787496.391817:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff919043c0ec00/0xe2c2ff68a6e843c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e843c8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785787496.391851:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1785787496.391853:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff919056a98000 from 30 10000000:01000000:0.0:1785787496.391856:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1785787496.391878:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff919040030800/0xe2c2ff68a6e843cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787496.391886:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff919040030800/0xe2c2ff68a6e843cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787496.391894:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff919040030800/0xe2c2ff68a6e843cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787496.391906:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769966336:0@lo:101: 00000100:00100000:0.0:1785787496.391931:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787496.391944:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190776bd0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785787496.391955:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769966336 00000100:00100000:0.0:1785787496.391958:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769966336 00000100:00100000:0.0:1785787496.391977:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1785787496.391983:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+16:5818:x1872533769966336:12345-0@lo:101: 00010000:00010000:0.0:1785787496.391991:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787496.392001:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919040030400/0xe2c2ff68a6e843d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e843cf expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787496.392020:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919040030400/0xe2c2ff68a6e843d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e843cf expref: 17 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787496.392030:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919040030400/0xe2c2ff68a6e843d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e843cf expref: 17 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787496.392048:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919040030400, rc 0) 00000100:00100000:0.0:1785787496.392075:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+17:5818:x1872533769966336:12345-0@lo:101: Request processed in 92us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787496.392081:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1785787496.392110:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769966336:0@lo:101: 00010000:00010000:0.0:1785787496.392120:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff919040030800/0xe2c2ff68a6e843cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e843d6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787496.392129:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff919040030800/0xe2c2ff68a6e843cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e843d6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787496.392162:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769966464:0@lo:501: 00000100:00100000:0.0:1785787496.392182:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787496.392193:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190776bd0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785787496.392202:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769966464 00000100:00100000:0.0:1785787496.392204:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769966464 00000100:00100000:0.0:1785787496.392225:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1785787496.392230:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+17:5818:x1872533769966464:12345-0@lo:501: 00000100:00100000:0.0:1785787496.392387:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+17:5818:x1872533769966464:12345-0@lo:501: Request processed in 156us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787496.392394:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1785787496.392420:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769966464:0@lo:501: 00000100:00100000:0.0:1785787496.392437:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769966592:0@lo:503: 00000100:00100000:0.0:1785787496.392464:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787496.392474:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190776bd0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785787496.392487:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769966592 00000100:00100000:0.0:1785787496.392490:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769966592 00000100:00100000:0.0:1785787496.392506:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1785787496.392510:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051539850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+17:5818:x1872533769966592:12345-0@lo:503: 00000100:00100000:0.0:1785787496.392610:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051539850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+17:5818:x1872533769966592:12345-0@lo:503: Request processed in 99us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787496.392616:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1785787496.392644:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769966592:0@lo:503: 00000100:00100000:3.0:1785787496.392857:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+15:5818:x1872533769965952:12345-0@lo:503: Request processed in 1243us (1405us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787496.392871:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1785787496.393338:0:7822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:7822:1872533769966720:0@lo:502: 00000100:00100000:1.0:1785787496.393373:0:7822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787496.393402:0:7822:0:(client.c:2702:ptlrpc_set_wait()) set ffff919048612180 going to sleep for 11 seconds 00000100:00100000:0.0:1785787496.393440:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769966720 00000100:00100000:0.0:1785787496.393443:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769966720 00000100:00100000:0.0:1785787496.393471:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1785787496.393476:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+16:7822:x1872533769966720:12345-0@lo:502: 00000100:00100000:0.0:1785787496.393616:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+16:7822:x1872533769966720:12345-0@lo:502: Request processed in 139us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787496.393623:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1785787496.393810:0:7822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:7822:1872533769966720:0@lo:502: 00000100:00100000:3.0:1785787496.393870:0:7822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907708a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:7822:1872533769966848:0@lo:502: 00000100:00100000:3.0:1785787496.393903:0:7822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787496.393921:0:7822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190557ed180 going to sleep for 11 seconds 00000100:00100000:1.0:1785787496.394030:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769966848 00000100:00100000:1.0:1785787496.394034:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769966848 00000100:00100000:1.0:1785787496.394056:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1785787496.394062:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051504c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+16:7822:x1872533769966848:12345-0@lo:502: 00000100:00100000:1.0:1785787496.394180:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051504c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+16:7822:x1872533769966848:12345-0@lo:502: Request processed in 117us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787496.394187:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1785787496.394321:0:7822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907708a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:7822:1872533769966848:0@lo:502: 00000040:00080000:3.0:1785787496.394340:0:7822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1785787496.394432:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1785787496.394447:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1785787496.394453:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff919040030800/0xe2c2ff68a6e843cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e843d6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787496.394462:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff919040030800/0xe2c2ff68a6e843cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e843d6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785787496.394469:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1785787496.394471:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff919056a98000 from 5 10000000:01000000:0.0:1785787496.394473:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1785787496.394490:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff919040030e00/0xe2c2ff68a6e843dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787496.394505:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff919040030e00/0xe2c2ff68a6e843dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787496.394513:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff919040030e00/0xe2c2ff68a6e843dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787496.394521:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769966976:0@lo:101: 00000100:00100000:0.0:1785787496.394543:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787496.394566:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190776bdc00 going to sleep for 11 seconds 00000100:00100000:1.0:1785787496.394598:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769966976 00000100:00100000:1.0:1785787496.394602:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769966976 00000100:00100000:1.0:1785787496.394627:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1785787496.394632:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051507050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+16:5818:x1872533769966976:12345-0@lo:101: 00010000:00010000:1.0:1785787496.394639:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787496.394649:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919043c0f600/0xe2c2ff68a6e843e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e843dd expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787496.394784:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919043c0f600/0xe2c2ff68a6e843e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e843dd expref: 17 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787496.394805:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919043c0f600/0xe2c2ff68a6e843e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e843dd expref: 17 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787496.394811:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919043c0f600, rc 0) 00000100:00100000:1.0:1785787496.394866:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051507050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+17:5818:x1872533769966976:12345-0@lo:101: Request processed in 233us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787496.394872:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1785787496.395019:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769966976:0@lo:101: 00010000:00010000:0.0:1785787496.395030:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff919040030e00/0xe2c2ff68a6e843dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e843e4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787496.395039:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff919040030e00/0xe2c2ff68a6e843dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e843e4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787496.395079:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769967104:0@lo:256: 00000100:00100000:0.0:1785787496.395106:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787496.395132:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190776bdc00 going to sleep for 11 seconds 00000100:00100000:1.0:1785787496.395167:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769967104 00000100:00100000:1.0:1785787496.395171:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769967104 00000100:00100000:1.0:1785787496.395210:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1785787496.395215:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051505c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+17:5818:x1872533769967104:12345-0@lo:256: 20000000:01000000:1.0:1785787496.395230:0:5814:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1785787496.395243:0:5814:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1785787496.395245:0:5814:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1785787496.395383:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051505c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+17:5818:x1872533769967104:12345-0@lo:256: Request processed in 167us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787496.395390:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1785787496.395441:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769967104:0@lo:256: 10000000:01000000:0.0:1785787496.395473:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1785787496.395478:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff919040030e00/0xe2c2ff68a6e843dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e843e4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787496.395484:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff919040030e00/0xe2c2ff68a6e843dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e843e4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785787496.395498:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1785787496.395500:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1785787496.395501:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1785787496.395514:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff919040030200/0xe2c2ff68a6e843eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787496.395520:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff919040030200/0xe2c2ff68a6e843eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787496.395526:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff919040030200/0xe2c2ff68a6e843eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787496.395535:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769967232:0@lo:101: 00000100:00100000:0.0:1785787496.395555:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787496.395571:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190776bdc00 going to sleep for 11 seconds 00000100:00100000:1.0:1785787496.395603:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769967232 00000100:00100000:1.0:1785787496.395607:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769967232 00000100:00100000:1.0:1785787496.395719:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1785787496.395774:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051505450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+17:5818:x1872533769967232:12345-0@lo:101: 00010000:00010000:1.0:1785787496.395781:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787496.395800:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919043c0e800/0xe2c2ff68a6e843f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e843eb expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787496.395813:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919043c0e800/0xe2c2ff68a6e843f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e843eb expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787496.395853:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919043c0e800/0xe2c2ff68a6e843f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e843eb expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787496.395860:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919043c0e800, rc 0) 00000100:00100000:1.0:1785787496.395885:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051505450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+18:5818:x1872533769967232:12345-0@lo:101: Request processed in 113us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787496.395890:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1785787496.395943:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769967232:0@lo:101: 00010000:00010000:0.0:1785787496.395952:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff919040030200/0xe2c2ff68a6e843eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e843f2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787496.395958:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff919040030200/0xe2c2ff68a6e843eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e843f2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787496.395989:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769967360:0@lo:501: 00000100:00100000:0.0:1785787496.396010:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787496.404053:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190776bdc00 going to sleep for 11 seconds 00000100:00100000:3.0:1785787496.408164:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769967360 00000100:00100000:3.0:1785787496.408179:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769967360 00000100:00100000:3.0:1785787496.408234:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1785787496.408243:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051507450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+18:5818:x1872533769967360:12345-0@lo:501: 00000100:00100000:3.0:1785787496.408546:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051507450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+18:5818:x1872533769967360:12345-0@lo:501: Request processed in 303us (12533us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787496.408559:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1785787496.409131:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769967360:0@lo:501: 00000100:00100000:0.0:1785787496.409172:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769967488:0@lo:503: 00000100:00100000:0.0:1785787496.409216:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787496.409250:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190776bdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1785787496.409262:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769967488 00000100:00100000:0.0:1785787496.409266:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769967488 00000100:00100000:0.0:1785787496.409308:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1785787496.409314:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051504850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+18:5818:x1872533769967488:12345-0@lo:503: 00000100:00100000:0.0:1785787496.409589:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051504850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+18:5818:x1872533769967488:12345-0@lo:503: Request processed in 274us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787496.409596:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1785787496.409627:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769967488:0@lo:503: 00000100:00100000:0.0:1785787496.413317:0:7823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:7823:1872533769967616:0@lo:502: 00000100:00100000:0.0:1785787496.413381:0:7823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787496.413418:0:7823:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190776bd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785787496.413471:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769967616 00000100:00100000:1.0:1785787496.413478:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769967616 00000100:00100000:1.0:1785787496.413552:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1785787496.413561:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051504450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+18:7823:x1872533769967616:12345-0@lo:502: 00000100:00100000:1.0:1785787496.414985:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051504450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+18:7823:x1872533769967616:12345-0@lo:502: Request processed in 1423us (1602us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787496.415001:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1785787496.419190:0:7823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:7823:1872533769967616:0@lo:502: 00000020:01000000:0.0:1785787496.419230:0:7823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1785787496.419237:0:7823:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1785787496.419245:0:7823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785787496.419248:0:7823:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1785787496.419252:0:7823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1785787496.419256:0:7823:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.153@tcp to nid 0x20000c0a8cb99 (192.168.203.153@tcp) 00000020:01000000:0.0:1785787496.419449:0:7823:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1785787496.419453:0:7823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1785787496.419467:0:7823:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9190515ccd40) 00000020:00000080:0.0:1785787496.419486:0:7823:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1785787496.419490:0:7823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1785787496.419576:0:7823:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1785787496.419581:0:7823:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:0.0:1785787496.419592:0:7823:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe2c2ff68a6e84400 00010000:00080000:0.0:1785787496.419618:0:7823:0:(ldlm_lib.c:102:import_set_conn()) imp ffff919045c7d800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.153@tcp at head 00010000:00010000:0.0:1785787496.420339:0:7823:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1785787496.420638:0:7823:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1785787496.420649:0:7823:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1785787496.421306:0:7823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1785787496.421509:0:7823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1785787496.421557:0:7823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1785787496.421616:0:7823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1785787496.422506:0:7824:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1785787496.422510:0:7824:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1785787496.423444:0:7823:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1785787496.423454:0:7823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1785787496.423481:0:7823:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1785787496.423500:0:7823:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe2c2ff68a6e84407 00000100:00080000:0.0:1785787496.423508:0:7823:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1785787496.423514:0:7823:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff919045c7d800 using connection 192.168.203.153@tcp/0@lo 00000100:00100000:0.0:1785787496.423544:0:7823:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff919077a9a300 x1872533769967744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1785787496.423570:0:7823:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1785787496.423616:0:7823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785787496.423619:0:7823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785787496.423621:0:7823:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1785787496.423624:0:7823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785787496.423628:0:7823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785787496.423630:0:7823:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1785787496.423633:0:7823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1785787496.423635:0:7823:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1785787496.423661:0:7823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a98a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:7823:1872533769967872:0@lo:502: 00000100:00100000:0.0:1785787496.423739:0:7823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787496.423774:0:7823:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905c6f7180 going to sleep for 11 seconds 00000100:00100000:1.0:1785787496.423996:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769968256:0@lo:400: 00000100:00100000:1.0:1785787496.424028:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787496.424049:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785787496.424055:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3335:1872533769968384:0@lo:400: 00000100:00100000:1.0:1785787496.424077:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787496.424105:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769968256 00000100:00100000:1.0:1785787496.424111:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769968256 00000100:00100000:1.0:1785787496.424154:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1785787496.424162:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905267c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769968256:12345-0@lo:400: 00000100:00100000:1.0:1785787496.424209:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905267c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769968256:12345-0@lo:400: Request processed in 48us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787496.424217:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1785787496.424237:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769968384 00000100:00100000:1.0:1785787496.424240:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769968384 00000100:00100000:1.0:1785787496.424266:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1785787496.424272:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905267c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3335:x1872533769968384:12345-0@lo:400: 00000100:00100000:1.0:1785787496.424303:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905267c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3335:x1872533769968384:12345-0@lo:400: Request processed in 31us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787496.424310:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1785787496.424324:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1785787496.424328:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1785787496.424354:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91905267d880 x1872533769968384/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787496.424366:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3335:1872533769968384:0@lo:400: 00010000:00080000:1.0:1785787496.424376:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91905267ca80 x1872533769968256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787496.424391:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769968256:0@lo:400: 00000100:00100000:0.0:1785787496.424474:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1872533769968000:0@lo:400: 00000100:00100000:0.0:1785787496.424501:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787496.424519:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785787496.424525:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3333:1872533769968128:0@lo:400: 00000100:00100000:0.0:1785787496.424545:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787496.424568:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769968000 00000100:00100000:0.0:1785787496.424572:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769968000 00000100:00100000:0.0:1785787496.424593:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769968128 00000100:00100000:0.0:1785787496.424596:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769968128 00000100:00100000:0.0:1785787496.424615:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1785787496.424621:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1872533769968000:12345-0@lo:400: 00000100:00100000:0.0:1785787496.424654:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1872533769968000:12345-0@lo:400: Request processed in 33us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787496.424660:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1785787496.424670:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1785787496.424676:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1872533769968128:12345-0@lo:400: 00000100:00100000:0.0:1785787496.424698:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1872533769968128:12345-0@lo:400: Request processed in 23us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787496.424703:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1785787496.424715:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1785787496.424740:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91905267d500 x1872533769968128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787496.424750:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3333:1872533769968128:0@lo:400: 00010000:00080000:0.0:1785787496.424757:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91905267e680 x1872533769968000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787496.424765:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1872533769968000:0@lo:400: 00000100:00100000:3.0:1785787496.425002:0:3332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3332:1872533769967744:0@lo:8: 00000100:00100000:3.0:1785787496.425034:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787496.425067:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769967872 00000100:00100000:3.0:1785787496.425071:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769967872 00000100:00100000:3.0:1785787496.425103:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1785787496.425110:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051506050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+18:7823:x1872533769967872:12345-0@lo:502: 00000100:00100000:3.0:1785787496.425302:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051506050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+18:7823:x1872533769967872:12345-0@lo:502: Request processed in 192us (1562us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787496.425309:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1785787496.425386:0:7823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a98a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:7823:1872533769967872:0@lo:502: 00000020:01000000:0.0:1785787496.425408:0:7823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785787496.425414:0:7823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785787496.425415:0:7823:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1785787496.425419:0:7823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:1.0:1785787496.425538:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769967744 00000100:00100000:1.0:1785787496.425542:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769967744 00000100:00100000:1.0:1785787496.425566:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1785787496.425570:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907708a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3332:x1872533769967744:12345-0@lo:8: 00010000:00080000:1.0:1785787496.425590:0:6619:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 283 last 0 00000020:00000080:1.0:1785787496.425611:0:6619:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe2c2ff68a6e8440e 00002000:00100000:1.0:1785787496.425624:0:6619:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff91905fade000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113801 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1785787496.425628:0:6619:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1785787496.425631:0:6619:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1785787496.425751:0:6619:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1785787496.425929:0:6619:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1785787496.425950:0:6619:0:(import.c:65:import_set_state_nolock()) ffff91905fadc000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1785787496.425989:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907708a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3332:x1872533769967744:12345-0@lo:8: Request processed in 417us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787496.425996:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000000:1.0:1785787496.426013:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1785787496.426029:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1785787496.426037:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff919040030200/0xe2c2ff68a6e843eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e843f2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787496.426046:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff919040030200/0xe2c2ff68a6e843eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e843f2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785787496.426055:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1785787496.426058:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9190515cb380 from 1 10000000:01000000:1.0:1785787496.426066:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1785787496.426089:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff919043c0fa00/0xe2c2ff68a6e84415 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787496.426097:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff919043c0fa00/0xe2c2ff68a6e84415 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787496.426105:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff919043c0fa00/0xe2c2ff68a6e84415 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787496.426118:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769968512:0@lo:101: 00000100:00100000:1.0:1785787496.426144:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787496.426159:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190469d1300 going to sleep for 11 seconds 00000100:00100000:1.0:1785787496.426172:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769968512 00000100:00100000:1.0:1785787496.426175:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769968512 00000100:00100000:1.0:1785787496.426196:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1785787496.426202:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051506850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+18:5818:x1872533769968512:12345-0@lo:101: 00010000:00010000:1.0:1785787496.426211:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787496.426221:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919043c0f800/0xe2c2ff68a6e8441c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e84415 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787496.426241:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919043c0f800/0xe2c2ff68a6e8441c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e84415 expref: 19 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787496.426250:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919043c0f800/0xe2c2ff68a6e8441c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e84415 expref: 19 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787496.426258:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919043c0f800, rc 0) 00000100:00100000:1.0:1785787496.426285:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051506850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+19:5818:x1872533769968512:12345-0@lo:101: Request processed in 83us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787496.426300:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1785787496.426336:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769968512:0@lo:101: 00010000:00010000:1.0:1785787496.426348:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff919043c0fa00/0xe2c2ff68a6e84415 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e8441c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787496.426357:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff919043c0fa00/0xe2c2ff68a6e84415 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e8441c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787496.426398:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769968640:0@lo:501: 00000100:00100000:1.0:1785787496.426423:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787496.426437:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff919048290e40 going to sleep for 11 seconds 00000100:00100000:1.0:1785787496.426448:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769968640 00000100:00100000:1.0:1785787496.426451:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769968640 00000100:00100000:1.0:1785787496.426471:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1785787496.426476:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051507850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+19:5818:x1872533769968640:12345-0@lo:501: 00000100:00100000:1.0:1785787496.426638:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051507850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+19:5818:x1872533769968640:12345-0@lo:501: Request processed in 160us (212us total) trans 0 rc -2/-2 00000100:00100000:1.0:1785787496.426645:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1785787496.426676:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769968640:0@lo:501: 10000000:01000000:1.0:1785787496.426693:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1785787496.426697:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff919043c0fa00/0xe2c2ff68a6e84415 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e8441c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787496.426705:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff919043c0fa00/0xe2c2ff68a6e84415 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e8441c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1785787496.427065:0:3332:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919077a9a300 x1872533769967744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1785787506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787496.427087:0:3332:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1785787496.427093:0:3332:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1785787496.427100:0:3332:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1785787496.427105:0:3332:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1785787496.427107:0:3332:0:(import.c:65:import_set_state_nolock()) ffff919045c7d800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1785787496.427129:0:3332:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1785787496.427135:0:3332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3332:1872533769967744:0@lo:8: 00000004:00080000:0.0:1785787496.427183:0:7824:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1785787496.427268:0:7824:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 283671439427ns, next at 0ns, rc = 0 00000004:00080000:3.0:1785787496.503567:0:5843:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1785787496.552491:0:7825:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1785787496.552520:0:7825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907708b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7825:1872533769968896:0@lo:7: 00000100:00100000:3.0:1785787496.552580:0:7825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787496.552620:0:7825:0:(client.c:2702:ptlrpc_set_wait()) set ffff918f41bf4540 going to sleep for 11 seconds 00000100:00100000:3.0:1785787496.552660:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077088e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533769968768:0@lo:13: 00000100:00100000:3.0:1785787496.552684:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787496.552733:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769968896 00000100:00100000:3.0:1785787496.552740:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769968896 00000100:00100000:3.0:1785787496.552802:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1785787496.552810:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077089180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7825:x1872533769968896:12345-0@lo:7: 00000100:00080000:2.0:1785787496.559594:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785787496.559615:0:6621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769968768 00000100:00100000:2.0:1785787496.559625:0:6621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769968768 00000100:00100000:2.0:1785787496.560436:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1785787496.560446:0:6621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907708b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3333:x1872533769968768:12345-0@lo:13: 00002000:00000024:2.0:1785787496.560478:0:6621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1785787496.560545:0:6621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907708b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3333:x1872533769968768:12345-0@lo:13: Request processed in 102us (7860us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787496.560551:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1785787496.560930:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919077088e00 x1872533769968768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787512 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787496.560958:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077088e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533769968768:0@lo:13: 00002000:00080000:3.0:1785787496.564024:0:6618:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1785787496.564030:0:6618:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1785787496.564094:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077089180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7825:x1872533769968896:12345-0@lo:7: Request processed in 11283us (11512us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787496.564103:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1785787496.564811:0:7825:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907708b100 x1872533769968896/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1785787512 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787496.564850:0:7825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907708b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7825:1872533769968896:0@lo:7: 00000004:00080000:1.0:1785787496.564861:0:7825:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1785787496.564893:0:7825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7825:1872533769969024:0@lo:5: 00000100:00100000:1.0:1785787496.564923:0:7825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787496.564954:0:7825:0:(client.c:2702:ptlrpc_set_wait()) set ffff919048290f00 going to sleep for 11 seconds 00000100:00100000:0.0:1785787496.565086:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769969024 00000100:00100000:0.0:1785787496.565092:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769969024 00000100:00100000:0.0:1785787496.565147:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1785787496.565155:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905267d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7825:x1872533769969024:12345-0@lo:5: 00002000:00080000:0.0:1785787496.565174:0:6617:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1785787496.565177:0:6617:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1785787496.565918:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905267d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7825:x1872533769969024:12345-0@lo:5: Request processed in 763us (992us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1785787496.565925:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1785787496.571915:0:7825:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91905267ca80 x1872533769969024/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1785787512 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787496.571935:0:7825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7825:1872533769969024:0@lo:5: 00000004:00080000:1.0:1785787496.571948:0:7825:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1785787496.573450:0:7825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a98a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7825:1872533769969152:0@lo:700: 00000100:00100000:0.0:1785787496.573504:0:7825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787496.573540:0:7825:0:(client.c:2702:ptlrpc_set_wait()) set ffff918f42eeec00 going to sleep for 11 seconds 00000100:00100000:1.0:1785787496.573756:0:6625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769969152 00000100:00100000:1.0:1785787496.573763:0:6625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769969152 00000100:00100000:1.0:1785787496.573815:0:6625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1785787496.573823:0:6625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7825:x1872533769969152:12345-0@lo:700: 00000100:00100000:1.0:1785787496.573873:0:6625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267f800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6625:1872533769969280:0@lo:700: 00000100:00100000:1.0:1785787496.573899:0:6625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787496.573917:0:6625:0:(client.c:2702:ptlrpc_set_wait()) set ffff919048290f00 going to sleep for 11 seconds 00000100:00100000:0.0:1785787496.574014:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769969280 00000100:00100000:0.0:1785787496.574019:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769969280 00000100:00100000:0.0:1785787496.574051:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1785787496.574058:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905267ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6625:x1872533769969280:12345-0@lo:700: 40000000:02000000:0.0:1785787496.638860:0:5827:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1785787496.654227:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905267ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6625:x1872533769969280:12345-0@lo:700: Request processed in 80161us (80319us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787496.654238:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1785787496.654568:0:6625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91905267f800 x1872533769969280/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1785787512 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787496.654581:0:6625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267f800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6625:1872533769969280:0@lo:700: 40000000:02000000:3.0:1785787496.654598:0:6625:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:3.0:1785787496.763118:0:6625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7825:x1872533769969152:12345-0@lo:700: Request processed in 189290us (189608us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787496.763130:0:6625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:3.0:1785787496.763161:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1785787496.763170:0:7522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:1.0:1785787496.763248:0:7825:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919077a98a80 x1872533769969152/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1785787512 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787496.763262:0:7825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a98a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7825:1872533769969152:0@lo:700: 00000004:02000040:1.0:1785787496.817853:0:7825:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1785787496.823920:0:7825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7825:1872533769969408:0@lo:5: 00000100:00100000:1.0:1785787496.823985:0:7825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787496.824031:0:7825:0:(client.c:2702:ptlrpc_set_wait()) set ffff919048290180 going to sleep for 11 seconds 00000100:00100000:2.0:1785787496.835620:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769969408 00000100:00100000:2.0:1785787496.835631:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769969408 00000100:00100000:2.0:1785787496.835686:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1785787496.835696:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905267ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7825:x1872533769969408:12345-0@lo:5: 00002000:00080000:2.0:1785787496.840498:0:6618:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1785787496.840513:0:6618:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1785787496.846505:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905267ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7825:x1872533769969408:12345-0@lo:5: Request processed in 10806us (22514us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1785787496.846518:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1785787496.846682:0:7825:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91905267f480 x1872533769969408/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1785787512 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787496.846694:0:7825:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1785787496.846710:0:7825:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff91905267f480 x1872533769969408/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1785787512 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787496.846731:0:7825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7825:1872533769969408:0@lo:5: 00000004:00080000:2.0:1785787496.846744:0:7825:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000001:02000400:2.0:1785787496.884812:0:7870:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg353-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1785787496.955180:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787497.976859:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787498.934323:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785787498.934346:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533769969536:0@lo:13: 00000100:00100000:0.0:1785787498.934407:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787498.934468:0:6621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769969536 00000100:00100000:0.0:1785787498.934486:0:6621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769969536 00000100:00100000:0.0:1785787498.934536:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1785787498.934546:0:6621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533769969536:12345-0@lo:13: 00002000:00000024:0.0:1785787498.934576:0:6621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785787498.934618:0:6621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533769969536:12345-0@lo:13: Request processed in 75us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787498.934625:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1785787498.934645:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1785787498.934672:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919077a99f80 x1872533769969536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787514 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787498.934690:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533769969536:0@lo:13: 00010000:00010000:0.0:1785787498.995953:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787500.019983:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787501.042963:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787501.498049:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3336:1872533769969792:0@lo:400: 00000100:00100000:3.0:1785787501.498109:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787501.498157:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fe14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769970304:0@lo:400: 00000100:00100000:3.0:1785787501.498178:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787501.498216:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1785787501.498222:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8642023-9103-4dbf-85d1-f204189bc871:3336:1872533769969664:0@lo:400: 00000100:00100000:3.0:1785787501.498245:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787501.498263:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fe16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3336:1872533769970176:0@lo:400: 00000100:00100000:3.0:1785787501.498284:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787501.498311:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769969792 00000100:00100000:3.0:1785787501.498318:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769969792 00000100:00100000:3.0:1785787501.498368:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769970176 00000100:00100000:3.0:1785787501.498371:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769970176 00000100:00100000:3.0:1785787501.498393:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1785787501.498401:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077089c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3336:x1872533769969792:12345-0@lo:400: 00000100:00100000:3.0:1785787501.498467:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077089c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3336:x1872533769969792:12345-0@lo:400: Request processed in 65us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787501.498482:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1785787501.498500:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1785787501.498505:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907708ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3336:x1872533769970176:12345-0@lo:400: 00000100:00100000:3.0:1785787501.498531:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907708ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3336:x1872533769970176:12345-0@lo:400: Request processed in 26us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787501.498536:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1785787501.498701:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769970304 00000100:00100000:3.0:1785787501.498705:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769970304 00000100:00100000:3.0:1785787501.498731:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1785787501.498737:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907708b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3336:x1872533769970304:12345-0@lo:400: 00000100:00100000:3.0:1785787501.498793:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907708b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3336:x1872533769970304:12345-0@lo:400: Request processed in 55us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787501.498799:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1785787501.498820:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785787501.498824:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1785787501.498866:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907fe16d80 x1872533769970176/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787501.498877:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fe16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3336:1872533769970176:0@lo:400: 00010000:00080000:3.0:1785787501.498887:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919077a9d500 x1872533769969792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787501.498895:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3336:1872533769969792:0@lo:400: 00010000:00080000:3.0:1785787501.498903:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907fe14380 x1872533769970304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787501.498911:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fe14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769970304:0@lo:400: 00000100:00100000:1.0:1785787501.499124:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769969664 00000100:00100000:1.0:1785787501.499129:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769969664 00000100:00100000:1.0:1785787501.499170:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1785787501.499177:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051505050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+19:3336:x1872533769969664:12345-0@lo:400: 00000100:00100000:1.0:1785787501.499216:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051505050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+19:3336:x1872533769969664:12345-0@lo:400: Request processed in 40us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787501.499222:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1785787501.499717:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3333:1872533769969920:0@lo:400: 00000100:00100000:2.0:1785787501.499744:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787501.499769:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785787501.499774:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533769970048:0@lo:400: 00000100:00100000:2.0:1785787501.499800:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787501.501063:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769970048 00000100:00100000:3.0:1785787501.501073:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769970048 00000100:00100000:3.0:1785787501.501114:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1785787501.501121:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533769970048:12345-0@lo:400: 00000100:00100000:3.0:1785787501.501164:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533769970048:12345-0@lo:400: Request processed in 44us (1362us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787501.501171:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1785787501.501221:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919077a9e680 x1872533769970048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787501.501232:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533769970048:0@lo:400: 00000100:00100000:3.0:1785787501.501249:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769969920 00000100:00100000:3.0:1785787501.501252:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769969920 00000100:00100000:3.0:1785787501.501276:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1785787501.501281:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1872533769969920:12345-0@lo:400: 00000100:00100000:3.0:1785787501.501315:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1872533769969920:12345-0@lo:400: Request processed in 33us (1569us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787501.501321:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1785787501.501858:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919077a9ca80 x1872533769969920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787501.501868:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3333:1872533769969920:0@lo:400: 00000100:00100000:3.0:1785787501.501890:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8642023-9103-4dbf-85d1-f204189bc871:3336:1872533769969664:0@lo:400: 00000100:00080000:2.0:1785787501.505436:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1785787501.505444:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785787502.008636:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533769970432:0@lo:13: 00000100:00100000:0.0:1785787502.008701:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787502.008776:0:6621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769970432 00000100:00100000:0.0:1785787502.008783:0:6621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769970432 00000100:00100000:0.0:1785787502.008856:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1785787502.008866:0:6621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3333:x1872533769970432:12345-0@lo:13: 00002000:00000024:0.0:1785787502.008908:0:6621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785787502.008950:0:6621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3333:x1872533769970432:12345-0@lo:13: Request processed in 86us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787502.008977:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1785787502.009021:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919077a99f80 x1872533769970432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787518 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787502.009037:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533769970432:0@lo:13: 00010000:00010000:1.0:1785787502.071782:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1785787502.142474:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1785787503.094955:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787503.243128:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787503.245077:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744779392 00000100:00100000:3.0:1785787503.245088:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744779392 00000100:00100000:3.0:1785787503.245149:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 114 00000100:00100000:3.0:1785787503.245157:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051504050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2387:x1872533744779392:12345-192.168.203.53@tcp:250: 00010000:00080000:3.0:1785787503.245181:0:5813:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 2ee04e69-b6fb-4c5f-9b75-18b5c664ac28@192.168.203.53@tcp t0 exp 0000000000000000 cur 290 last 0 00000020:00000080:3.0:1785787503.245218:0:5813:0:(genops.c:1406:class_connect()) connect: client 2ee04e69-b6fb-4c5f-9b75-18b5c664ac28, cookie 0xe2c2ff68a6e84423 00000100:00080000:3.0:1785787503.245339:0:5813:0:(import.c:65:import_set_state_nolock()) ffff919077062000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1785787503.245414:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051504050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+5:2387:x1872533744779392:12345-192.168.203.53@tcp:250: Request processed in 256us (2295us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787503.245421:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 114 00000100:00100000:3.0:1785787503.246754:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787503.247926:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744779520 00000100:00100000:0.0:1785787503.247935:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744779520 00000100:00100000:0.0:1785787503.247987:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 115 00000100:00100000:0.0:1785787503.247996:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051507c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+5:5596:x1872533744779520:12345-192.168.203.53@tcp:101: 00010000:00010000:0.0:1785787503.248009:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787503.248027:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919050679600/0xe2c2ff68a6e8442a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd1e2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787503.248054:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919050679600/0xe2c2ff68a6e8442a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd1e2 expref: 6 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787503.248065:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919050679600/0xe2c2ff68a6e8442a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd1e2 expref: 6 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787503.248073:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919050679600, rc 0) 00000100:00100000:0.0:1785787503.248124:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051507c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+6:5596:x1872533744779520:12345-192.168.203.53@tcp:101: Request processed in 129us (1373us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787503.248131:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 115 00000100:00100000:0.0:1785787503.266893:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787503.279468:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744779648 00000100:00100000:1.0:1785787503.279480:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744779648 00000100:00100000:1.0:1785787503.279535:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 116 00000100:00100000:1.0:1785787503.279546:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051506c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+6:5596:x1872533744779648:12345-192.168.203.53@tcp:501: 00000100:00100000:1.0:1785787503.279842:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051506c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+6:5596:x1872533744779648:12345-192.168.203.53@tcp:501: Request processed in 283us (13008us total) trans 0 rc -2/-2 00000100:00100000:1.0:1785787503.279850:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 116 00000100:00100000:2.0:1785787503.301224:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787503.309744:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744779776 00000100:00100000:3.0:1785787503.309757:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744779776 00000100:00100000:3.0:1785787503.309809:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 117 00000100:00100000:3.0:1785787503.309818:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051505850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+6:5596:x1872533744779776:12345-192.168.203.53@tcp:101: 00010000:00010000:3.0:1785787503.309843:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787503.309860:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91905f903400/0xe2c2ff68a6e84431 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd1e9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787503.309884:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91905f903400/0xe2c2ff68a6e84431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd1e9 expref: 7 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787503.309895:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91905f903400/0xe2c2ff68a6e84431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd1e9 expref: 7 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787503.309905:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f903400, rc 0) 00000100:00100000:3.0:1785787503.309973:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051505850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+7:5596:x1872533744779776:12345-192.168.203.53@tcp:101: Request processed in 156us (8757us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787503.309980:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 117 00000100:00100000:3.0:1785787503.311625:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787503.311661:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744779904 00000100:00100000:3.0:1785787503.311665:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744779904 00000100:00100000:3.0:1785787503.311690:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 118 00000100:00100000:3.0:1785787503.311707:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051506450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+7:5596:x1872533744779904:12345-192.168.203.53@tcp:501: 00000100:00100000:3.0:1785787503.311964:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051506450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+8:5596:x1872533744779904:12345-192.168.203.53@tcp:501: Request processed in 258us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787503.311972:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 118 00000100:00100000:3.0:1785787503.324491:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787503.324534:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744780032 00000100:00100000:3.0:1785787503.324542:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744780032 00000100:00100000:3.0:1785787503.324594:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 119 00000100:00100000:3.0:1785787503.324602:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+8:5596:x1872533744780032:12345-192.168.203.53@tcp:503: 00000100:00100000:3.0:1785787503.325126:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+8:5596:x1872533744780032:12345-192.168.203.53@tcp:503: Request processed in 523us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787503.325133:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 119 00000100:00100000:1.0:1785787503.332054:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787503.332087:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744780160 00000100:00100000:1.0:1785787503.332095:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744780160 00000100:00100000:1.0:1785787503.332149:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 120 00000100:00100000:1.0:1785787503.332157:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+8:5614:x1872533744780160:12345-192.168.203.53@tcp:502: 00000100:00100000:1.0:1785787503.332440:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+8:5614:x1872533744780160:12345-192.168.203.53@tcp:502: Request processed in 282us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787503.332447:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 120 00000100:00100000:3.0:1785787503.365130:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787503.365825:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744780288 00000100:00100000:2.0:1785787503.365871:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744780288 00000100:00100000:2.0:1785787503.365917:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 121 00000100:00100000:2.0:1785787503.365927:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+8:5614:x1872533744780288:12345-192.168.203.53@tcp:502: 00000100:00100000:2.0:1785787503.366210:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+8:5614:x1872533744780288:12345-192.168.203.53@tcp:502: Request processed in 284us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787503.366218:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 121 00000100:00100000:1.0:1785787503.376843:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787503.376939:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744780416 00000100:00100000:3.0:1785787503.376949:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744780416 00000100:00100000:3.0:1785787503.377003:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 122 00000100:00100000:3.0:1785787503.377012:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+8:5596:x1872533744780416:12345-192.168.203.53@tcp:101: 00010000:00010000:3.0:1785787503.377028:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787503.377045:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91905f902e00/0xe2c2ff68a6e84438 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd213 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787503.377070:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91905f902e00/0xe2c2ff68a6e84438 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd213 expref: 9 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787503.377080:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91905f902e00/0xe2c2ff68a6e84438 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd213 expref: 9 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787503.377099:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f902e00, rc 0) 00000100:00100000:3.0:1785787503.377149:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+9:5596:x1872533744780416:12345-192.168.203.53@tcp:101: Request processed in 138us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787503.377156:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 122 00000100:00100000:3.0:1785787503.385860:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787503.385968:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744780544 00000100:00100000:2.0:1785787503.385976:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744780544 00000100:00100000:2.0:1785787503.386020:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 123 00000100:00100000:2.0:1785787503.386028:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+9:5596:x1872533744780544:12345-192.168.203.53@tcp:256: 20000000:01000000:2.0:1785787503.386051:0:5812:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1785787503.386073:0:5812:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1785787503.386077:0:5812:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1785787503.386080:0:5812:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1785787503.386082:0:5812:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1785787503.398224:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+9:5596:x1872533744780544:12345-192.168.203.53@tcp:256: Request processed in 12187us (12364us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787503.398238:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 123 00000100:00100000:2.0:1785787503.402926:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787503.403065:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744780672 00000100:00100000:3.0:1785787503.403074:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744780672 00000100:00100000:3.0:1785787503.403120:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 124 00000100:00100000:3.0:1785787503.403128:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+9:5596:x1872533744780672:12345-192.168.203.53@tcp:101: 00010000:00010000:3.0:1785787503.403141:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787503.403156:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91905f903c00/0xe2c2ff68a6e8443f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd21a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787503.403178:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91905f903c00/0xe2c2ff68a6e8443f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd21a expref: 10 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787503.403187:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91905f903c00/0xe2c2ff68a6e8443f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd21a expref: 10 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787503.403195:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f903c00, rc 0) 00000100:00100000:3.0:1785787503.403231:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:5596:x1872533744780672:12345-192.168.203.53@tcp:101: Request processed in 104us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787503.403237:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 124 00000100:00100000:3.0:1785787503.408430:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787503.408548:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744780800 00000100:00100000:0.0:1785787503.408556:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744780800 00000100:00100000:0.0:1785787503.408607:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 125 00000100:00100000:0.0:1785787503.408628:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:5596:x1872533744780800:12345-192.168.203.53@tcp:501: 00000100:00100000:0.0:1785787503.408907:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:5596:x1872533744780800:12345-192.168.203.53@tcp:501: Request processed in 279us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787503.408915:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 125 00000100:00100000:1.0:1785787503.413011:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787503.413600:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744780928 00000100:00100000:3.0:1785787503.413617:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744780928 00000100:00100000:3.0:1785787503.413681:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 126 00000100:00100000:3.0:1785787503.413691:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:5596:x1872533744780928:12345-192.168.203.53@tcp:503: 00000100:00100000:3.0:1785787503.414066:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:5596:x1872533744780928:12345-192.168.203.53@tcp:503: Request processed in 376us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787503.414074:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 126 00000100:00100000:2.0:1785787503.431319:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787503.431631:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744781056 00000100:00100000:3.0:1785787503.431640:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744781056 00000100:00100000:3.0:1785787503.431688:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 127 00000100:00100000:3.0:1785787503.431697:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:5619:x1872533744781056:12345-192.168.203.53@tcp:502: 00000100:00100000:3.0:1785787503.431950:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:5619:x1872533744781056:12345-192.168.203.53@tcp:502: Request processed in 253us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787503.431957:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 127 00000100:00100000:3.0:1785787503.434256:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787503.434436:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744781184 00000100:00100000:0.0:1785787503.434444:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744781184 00000100:00100000:0.0:1785787503.434492:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 128 00000100:00100000:0.0:1785787503.434501:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051581050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:5619:x1872533744781184:12345-192.168.203.53@tcp:502: 00000100:00100000:0.0:1785787503.434687:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051581050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:5619:x1872533744781184:12345-192.168.203.53@tcp:502: Request processed in 187us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787503.434695:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 128 00000100:00100000:0.0:1785787503.438488:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787503.438659:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744781312 00000100:00100000:3.0:1785787503.438668:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744781312 00000100:00100000:3.0:1785787503.438707:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 4 00000100:00100000:3.0:1785787503.438716:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2387:x1872533744781312:12345-192.168.203.53@tcp:38: 00010000:00080000:3.0:1785787503.438751:0:5822:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 79280304-55c6-4698-bfc3-29d14648ba45@192.168.203.53@tcp t0 exp 0000000000000000 cur 290 last 0 00000020:00000080:3.0:1785787503.438794:0:5822:0:(genops.c:1406:class_connect()) connect: client 79280304-55c6-4698-bfc3-29d14648ba45, cookie 0xe2c2ff68a6e84446 00000004:00100000:3.0:1785787503.438819:0:5822:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1785787503.438826:0:5822:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1785787503.477333:0:5822:0:(import.c:65:import_set_state_nolock()) ffff919077061800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1785787503.477413:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+6:2387:x1872533744781312:12345-192.168.203.53@tcp:38: Request processed in 38696us (38940us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787503.477423:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 4 00000100:00100000:3.0:1785787504.051024:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533769970560:0@lo:13: 00000100:00100000:3.0:1785787504.051098:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787504.051212:0:6621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769970560 00000100:00100000:1.0:1785787504.051219:0:6621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769970560 00000100:00100000:1.0:1785787504.051275:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1785787504.051284:0:6621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077088380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533769970560:12345-0@lo:13: 00002000:00000024:1.0:1785787504.051314:0:6621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1785787504.051433:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785787504.057502:0:6621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077088380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533769970560:12345-0@lo:13: Request processed in 6212us (6396us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787504.057515:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1785787504.057902:0:3334:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919077a98a80 x1872533769970560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787520 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787504.057924:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533769970560:0@lo:13: 00010000:00010000:1.0:1785787504.115102:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785787504.493248:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787504.493377:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744781440 00000100:00100000:3.0:1785787504.493385:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744781440 00000100:00100000:3.0:1785787504.493449:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 5 00000100:00100000:3.0:1785787504.493458:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+6:0:x1872533744781440:12345-192.168.203.53@tcp:41: 00000004:00000024:3.0:1785787504.493502:0:5821:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1785787504.493572:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+6:0:x1872533744781440:12345-192.168.203.53@tcp:41: Request processed in 116us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787504.493580:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 5 00000100:00080000:2.0:1785787504.493811:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785787504.498796:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787504.498989:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744781568 00000100:00100000:0.0:1785787504.498998:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744781568 00000100:00100000:0.0:1785787504.499051:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 6 00000100:00100000:0.0:1785787504.499061:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907708bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+6:5596:x1872533744781568:12345-192.168.203.53@tcp:41: 00000004:00000024:0.0:1785787504.499088:0:5822:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1785787504.499150:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907708bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+6:5596:x1872533744781568:12345-192.168.203.53@tcp:41: Request processed in 90us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787504.499158:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 6 00000100:00100000:1.0:1785787504.504678:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787504.507572:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744781696 00000100:00100000:0.0:1785787504.508556:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744781696 00000100:00100000:0.0:1785787504.508846:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 7 00000100:00100000:0.0:1785787504.508858:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905267ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+6:5596:x1872533744781696:12345-192.168.203.53@tcp:40: 00000100:00100000:0.0:1785787504.508957:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905267ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+6:5596:x1872533744781696:12345-192.168.203.53@tcp:40: Request processed in 100us (4287us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787504.508977:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 7 00000100:00100000:2.0:1785787504.514204:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787504.514247:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787504.514285:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787504.514320:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787504.514395:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744782208 00000100:00100000:1.0:1785787504.514405:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744782208 00000100:00100000:1.0:1785787504.514459:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 129 00000100:00100000:1.0:1785787504.514473:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051580050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:2389:x1872533744782208:12345-192.168.203.53@tcp:400: 00000100:00100000:1.0:1785787504.514540:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051580050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:2389:x1872533744782208:12345-192.168.203.53@tcp:400: Request processed in 72us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787504.514548:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 129 00000100:00100000:3.0:1785787504.515128:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744782080 00000100:00100000:3.0:1785787504.515133:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744782080 00000100:00100000:3.0:1785787504.515173:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 0 00000100:00100000:3.0:1785787504.515180:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+6:5596:x1872533744782080:12345-192.168.203.53@tcp:33: 00000100:00100000:2.0:1785787504.515314:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744781824 00000100:00100000:2.0:1785787504.515318:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744781824 00000100:00100000:2.0:1785787504.515337:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744781952 00000100:00100000:2.0:1785787504.515339:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744781952 00000100:00100000:2.0:1785787504.515350:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 8 00000100:00100000:2.0:1785787504.515365:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2387:x1872533744781824:12345-192.168.203.53@tcp:8: 00010000:00080000:2.0:1785787504.515386:0:6619:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 79280304-55c6-4698-bfc3-29d14648ba45@192.168.203.53@tcp t0 exp 0000000000000000 cur 291 last 0 00000020:00000080:2.0:1785787504.515409:0:6619:0:(genops.c:1406:class_connect()) connect: client 79280304-55c6-4698-bfc3-29d14648ba45, cookie 0xe2c2ff68a6e8444d 00002000:00100000:2.0:1785787504.515419:0:6619:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 79280304-55c6-4698-bfc3-29d14648ba45/ffff91907fe0a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113801 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1785787504.515429:0:6619:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1785787504.515772:0:6619:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1785787504.515798:0:6619:0:(import.c:65:import_set_state_nolock()) ffff91907fe09000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1785787504.515866:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:79280304-55c6-4698-bfc3-29d14648ba45+6:2387:x1872533744781824:12345-192.168.203.53@tcp:8: Request processed in 500us (1580us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787504.515873:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 8 00000100:00100000:2.0:1785787504.515888:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 9 00000100:00100000:2.0:1785787504.515893:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2387:x1872533744781952:12345-192.168.203.53@tcp:8: 00010000:00080000:2.0:1785787504.515908:0:6619:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 79280304-55c6-4698-bfc3-29d14648ba45@192.168.203.53@tcp t0 exp 0000000000000000 cur 291 last 0 00000020:00000080:2.0:1785787504.515922:0:6619:0:(genops.c:1406:class_connect()) connect: client 79280304-55c6-4698-bfc3-29d14648ba45, cookie 0xe2c2ff68a6e84454 00002000:00100000:2.0:1785787504.515927:0:6619:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 79280304-55c6-4698-bfc3-29d14648ba45/ffff91907fe0f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113801 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1785787504.515941:0:6619:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1785787504.516124:0:6619:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1785787504.516139:0:6619:0:(import.c:65:import_set_state_nolock()) ffff91907fe0d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1785787504.516166:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:79280304-55c6-4698-bfc3-29d14648ba45+6:2387:x1872533744781952:12345-192.168.203.53@tcp:8: Request processed in 271us (1845us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787504.516173:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 9 00000004:00080000:3.0:1785787504.548650:0:5823:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 33414us 00000004:00200000:0.0:1785787504.574855:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1785787504.579508:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+6:5596:x1872533744782080:12345-192.168.203.53@tcp:33: Request processed in 64317us (65302us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787504.579530:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 0 00000100:00100000:1.0:1785787504.835345:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787504.835419:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744782336 00000100:00100000:3.0:1785787504.835428:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744782336 00000100:00100000:3.0:1785787504.835487:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 8 00000100:00100000:3.0:1785787504.835496:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905267f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+6:5636:x1872533744782336:12345-192.168.203.53@tcp:101: 00010000:00010000:3.0:1785787504.835514:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787504.835537:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902400/0xe2c2ff68a6e8445b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd244 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787504.835620:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84462 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787504.835634:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84462 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787504.835648:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84462 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785787504.836060:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1785787504.836064:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1785787504.836135:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84462 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787504.836159:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902400/0xe2c2ff68a6e8445b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd244 expref: 8 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787504.836175:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84462 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd244 expref: 7 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787504.836183:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919055acd200) 00010000:00010000:3.0:1785787504.836186:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785787504.836189:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f903e00, rc 0) 00000100:00100000:3.0:1785787504.836244:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905267f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+7:5636:x1872533744782336:12345-192.168.203.53@tcp:101: Request processed in 748us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787504.836250:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 8 00010000:00010000:1.0:1785787505.140191:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787506.165814:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785787506.611124:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8642023-9103-4dbf-85d1-f204189bc871:3335:1872533769970688:0@lo:400: 00000100:00100000:2.0:1785787506.611193:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787506.611765:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769970688 00000100:00100000:3.0:1785787506.611774:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769970688 00000100:00100000:3.0:1785787506.611857:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1785787506.611867:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051583c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+19:3335:x1872533769970688:12345-0@lo:400: 00000100:00100000:0.0:1785787506.612799:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3336:1872533769970816:0@lo:400: 00000100:00100000:0.0:1785787506.612854:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787506.612892:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769970816 00000100:00100000:0.0:1785787506.612896:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769970816 00000100:00100000:0.0:1785787506.612927:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1785787506.612934:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3336:x1872533769970816:12345-0@lo:400: 00000100:00100000:0.0:1785787506.612971:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3336:x1872533769970816:12345-0@lo:400: Request processed in 37us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787506.612979:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1785787506.613020:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3336:1872533769970816:0@lo:400: 00000100:00100000:3.0:1785787506.624074:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051583c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+19:3335:x1872533769970688:12345-0@lo:400: Request processed in 12200us (12871us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787506.624087:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1785787506.625797:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3333:1872533769970944:0@lo:400: 00000100:00100000:0.0:1785787506.625881:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787506.625949:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769970944 00000100:00100000:3.0:1785787506.625956:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769970944 00000100:00100000:3.0:1785787506.626014:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1785787506.626024:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1872533769970944:12345-0@lo:400: 00000100:00100000:2.0:1785787506.628688:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8642023-9103-4dbf-85d1-f204189bc871:3335:1872533769970688:0@lo:400: 00000100:00080000:2.0:1785787506.628739:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785787506.632249:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1872533769970944:12345-0@lo:400: Request processed in 6220us (6360us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787506.632261:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1785787506.632351:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533769971072:0@lo:400: 00000100:00100000:3.0:1785787506.632406:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787506.632457:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769971072 00000100:00100000:3.0:1785787506.632463:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769971072 00000100:00100000:3.0:1785787506.632509:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1785787506.632518:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907708aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533769971072:12345-0@lo:400: 00000100:00100000:3.0:1785787506.632566:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907708aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533769971072:12345-0@lo:400: Request processed in 49us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787506.632572:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1785787506.632782:0:3334:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9190514f7800 x1872533769971072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787506.632795:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533769971072:0@lo:400: 00000100:00080000:3.0:1785787506.632817:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785787506.634812:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769971328:0@lo:400: 00000100:00100000:1.0:1785787506.634864:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787506.634897:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785787506.634915:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3336:1872533769971200:0@lo:400: 00000100:00100000:1.0:1785787506.634939:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787506.634974:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769971328 00000100:00100000:1.0:1785787506.634979:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769971328 00000100:00100000:1.0:1785787506.635014:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1785787506.635020:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769971328:12345-0@lo:400: 00000100:00100000:1.0:1785787506.635058:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769971328:12345-0@lo:400: Request processed in 37us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787506.635065:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1785787506.635079:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1785787506.635097:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9190514f7480 x1872533769971328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787506.635107:0:3336:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1785787506.635117:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769971328:0@lo:400: 00000100:00100000:1.0:1785787506.635138:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769971200 00000100:00100000:1.0:1785787506.635141:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769971200 00000100:00100000:1.0:1785787506.635167:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1785787506.635172:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3336:x1872533769971200:12345-0@lo:400: 00000100:00100000:1.0:1785787506.635201:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3336:x1872533769971200:12345-0@lo:400: Request processed in 29us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787506.635207:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1785787506.635218:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785787506.635232:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3336:1872533769971200:0@lo:400: 00000100:00100000:0.0:1785787506.636056:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3333:1872533769970944:0@lo:400: 00000100:00100000:3.0:1785787507.123028:0:3334:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785787507.127426:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076edc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533769971456:0@lo:13: 00000100:00100000:3.0:1785787507.127565:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787507.129556:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769971456 00000100:00100000:0.0:1785787507.129567:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769971456 00000100:00100000:0.0:1785787507.129634:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1785787507.129644:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077088000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533769971456:12345-0@lo:13: 00002000:00000024:0.0:1785787507.129676:0:6620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785787507.129745:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077088000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533769971456:12345-0@lo:13: Request processed in 103us (2180us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787507.129764:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1785787507.130046:0:3334:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076edc700 x1872533769971456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787523 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787507.130065:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076edc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533769971456:0@lo:13: 00010000:00010000:1.0:1785787507.187144:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787507.251543:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787507.251672:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744782464 00000100:00100000:3.0:1785787507.251681:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744782464 00000100:00100000:3.0:1785787507.251761:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 9 00000100:00100000:3.0:1785787507.251771:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076edd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+7:5688:x1872533744782464:12345-192.168.203.53@tcp:41: 00000004:00000024:3.0:1785787507.251809:0:5821:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1785787507.251894:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076edd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+7:5688:x1872533744782464:12345-192.168.203.53@tcp:41: Request processed in 124us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787507.251902:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 9 00000100:00080000:1.0:1785787507.252075:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785787507.263467:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787507.263556:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744782592 00000100:00100000:0.0:1785787507.263565:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744782592 00000100:00100000:0.0:1785787507.263647:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 11 00000100:00100000:0.0:1785787507.263657:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:79280304-55c6-4698-bfc3-29d14648ba45+6:5688:x1872533744782592:12345-192.168.203.53@tcp:13: 00002000:00000024:0.0:1785787507.263693:0:6620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785787507.263768:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:79280304-55c6-4698-bfc3-29d14648ba45+6:5688:x1872533744782592:12345-192.168.203.53@tcp:13: Request processed in 112us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787507.263775:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 11 00000100:00080000:1.0:1785787507.264183:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785787507.273278:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787507.273667:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744782720 00000100:00100000:0.0:1785787507.273677:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744782720 00000100:00100000:0.0:1785787507.273755:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 12 00000100:00100000:0.0:1785787507.273765:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:79280304-55c6-4698-bfc3-29d14648ba45+6:5688:x1872533744782720:12345-192.168.203.53@tcp:13: 00002000:00000024:0.0:1785787507.273791:0:6620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785787507.273926:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:79280304-55c6-4698-bfc3-29d14648ba45+6:5688:x1872533744782720:12345-192.168.203.53@tcp:13: Request processed in 161us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787507.273934:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 12 00000100:00080000:1.0:1785787507.274038:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1785787508.220207:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1785787508.221075:0:6642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 79280304-55c6-4698-bfc3-29d14648ba45 00000001:00100000:0.0:1785787508.729261:0:5843:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 79280304-55c6-4698-bfc3-29d14648ba45 00000100:00100000:0.0:1785787509.174123:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785787509.174145:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076edd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533769971584:0@lo:13: 00000100:00100000:0.0:1785787509.174206:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787509.174279:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769971584 00000100:00100000:1.0:1785787509.174287:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769971584 00000100:00100000:1.0:1785787509.174362:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1785787509.174373:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076edf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533769971584:12345-0@lo:13: 00000100:00100000:3.0:1785787509.174374:0:6621:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1785787509.174398:0:6621:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:1.0:1785787509.174412:0:6620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785787509.174478:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076edf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533769971584:12345-0@lo:13: Request processed in 106us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787509.174486:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1785787509.174804:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1785787509.174853:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076edd180 x1872533769971584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787525 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787509.174885:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076edd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533769971584:0@lo:13: 00000001:00100000:3.0:1785787509.211275:0:7522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 79280304-55c6-4698-bfc3-29d14648ba45 00010000:00010000:1.0:1785787509.235535:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787509.904071:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787509.904104:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787509.904132:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787509.904151:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787509.904175:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744783104 00000100:00100000:0.0:1785787509.904182:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744783104 00000100:00100000:0.0:1785787509.904225:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744783232 00000100:00100000:0.0:1785787509.904227:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744783232 00000100:00100000:0.0:1785787509.904242:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 10 00000100:00100000:0.0:1785787509.904250:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+5:2390:x1872533744783104:12345-192.168.203.53@tcp:400: 00000100:00100000:0.0:1785787509.904306:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+5:2390:x1872533744783104:12345-192.168.203.53@tcp:400: Request processed in 57us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787509.904314:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 10 00000100:00100000:0.0:1785787509.904329:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 11 00000100:00100000:0.0:1785787509.904335:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076edf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+5:2390:x1872533744783232:12345-192.168.203.53@tcp:400: 00000100:00100000:0.0:1785787509.904353:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076edf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+5:2390:x1872533744783232:12345-192.168.203.53@tcp:400: Request processed in 19us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787509.904359:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 11 00000100:00080000:0.0:1785787509.904372:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785787509.904376:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785787509.904413:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744782976 00000100:00100000:3.0:1785787509.904416:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744782976 00000100:00100000:3.0:1785787509.904459:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 27 00000100:00100000:3.0:1785787509.904467:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076edd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+6:2390:x1872533744782976:12345-192.168.203.53@tcp:400: 00000100:00100000:3.0:1785787509.904492:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076edd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+6:2390:x1872533744782976:12345-192.168.203.53@tcp:400: Request processed in 28us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787509.904498:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 27 00000100:00100000:2.0:1785787509.904594:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744782848 00000100:00100000:2.0:1785787509.904598:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744782848 00000100:00100000:2.0:1785787509.904629:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 131 00000100:00100000:2.0:1785787509.904636:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051582c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:2390:x1872533744782848:12345-192.168.203.53@tcp:400: 00000100:00100000:2.0:1785787509.904661:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051582c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:2390:x1872533744782848:12345-192.168.203.53@tcp:400: Request processed in 26us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787509.904667:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 131 00000100:00080000:0.0:1785787509.905732:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1785787510.259726:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1785787510.342088:0:8177:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1785787511.286387:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787511.734007:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077089500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3336:1872533769971840:0@lo:400: 00000100:00100000:3.0:1785787511.734069:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787511.734112:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907708a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769972352:0@lo:400: 00000100:00100000:3.0:1785787511.734146:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787511.734177:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1785787511.734183:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077088a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8642023-9103-4dbf-85d1-f204189bc871:3336:1872533769971712:0@lo:400: 00000100:00100000:3.0:1785787511.734207:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787511.734225:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077089f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3336:1872533769972224:0@lo:400: 00000100:00100000:3.0:1785787511.734243:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787511.734265:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907708b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3333:1872533769971968:0@lo:400: 00000100:00100000:3.0:1785787511.734287:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787511.734303:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785787511.734308:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077088e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533769972096:0@lo:400: 00000100:00100000:3.0:1785787511.734330:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787511.734358:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769971840 00000100:00100000:3.0:1785787511.734364:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769971840 00000100:00100000:3.0:1785787511.734397:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769972224 00000100:00100000:3.0:1785787511.734400:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769972224 00000100:00100000:3.0:1785787511.734483:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769971968 00000100:00100000:3.0:1785787511.734487:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769971968 00000100:00100000:3.0:1785787511.734507:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1785787511.734515:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3336:x1872533769971840:12345-0@lo:400: 00000100:00100000:3.0:1785787511.734690:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3336:x1872533769971840:12345-0@lo:400: Request processed in 174us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787511.734697:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1785787511.734713:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1785787511.734719:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3336:x1872533769972224:12345-0@lo:400: 00000100:00100000:3.0:1785787511.734746:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3336:x1872533769972224:12345-0@lo:400: Request processed in 28us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787511.734752:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1785787511.734771:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1785787511.734777:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1872533769971968:12345-0@lo:400: 00000100:00100000:3.0:1785787511.734808:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1872533769971968:12345-0@lo:400: Request processed in 31us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787511.734814:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1785787511.734846:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769972352 00000100:00100000:3.0:1785787511.734849:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769972352 00000100:00100000:3.0:1785787511.734873:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769972096 00000100:00100000:3.0:1785787511.734875:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769972096 00000100:00100000:3.0:1785787511.734889:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1785787511.734895:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769972352:12345-0@lo:400: 00000100:00100000:3.0:1785787511.734923:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769972352:12345-0@lo:400: Request processed in 29us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787511.734929:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1785787511.734940:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1785787511.734945:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b374a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533769972096:12345-0@lo:400: 00000100:00100000:3.0:1785787511.734966:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b374a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533769972096:12345-0@lo:400: Request processed in 22us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787511.734971:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1785787511.734986:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769971712 00000100:00100000:3.0:1785787511.734989:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769971712 00000100:00100000:3.0:1785787511.735009:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1785787511.735014:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051581850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+19:3336:x1872533769971712:12345-0@lo:400: 00000100:00100000:3.0:1785787511.735037:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051581850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+19:3336:x1872533769971712:12345-0@lo:400: Request processed in 22us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787511.735042:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:3.0:1785787511.735069:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785787511.735079:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785787511.735082:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1785787511.735106:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919077088e00 x1872533769972096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787511.735119:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077088e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533769972096:0@lo:400: 00000100:00100000:3.0:1785787511.735129:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907708b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3333:1872533769971968:0@lo:400: 00000100:00100000:2.0:1785787511.740942:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077089500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3336:1872533769971840:0@lo:400: 00010000:00080000:2.0:1785787511.740960:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907708a300 x1872533769972352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787511.740970:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907708a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769972352:0@lo:400: 00000100:00100000:2.0:1785787511.740993:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077088a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8642023-9103-4dbf-85d1-f204189bc871:3336:1872533769971712:0@lo:400: 00000100:00100000:2.0:1785787511.741004:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077089f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3336:1872533769972224:0@lo:400: 00000100:00100000:1.0:1785787512.247198:0:3334:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785787512.247219:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076eded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533769972480:0@lo:13: 00000100:00100000:1.0:1785787512.247276:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787512.247369:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769972480 00000100:00100000:0.0:1785787512.247376:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769972480 00000100:00100000:0.0:1785787512.247422:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1785787512.247430:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533769972480:12345-0@lo:13: 00002000:00000024:0.0:1785787512.247468:0:6620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785787512.247510:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533769972480:12345-0@lo:13: Request processed in 81us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787512.247516:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1785787512.247682:0:3334:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076eded80 x1872533769972480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787528 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787512.247699:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076eded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533769972480:0@lo:13: 00010000:00010000:3.0:1785787512.307758:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787513.333844:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785787514.292644:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785787514.292676:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fe17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533769972608:0@lo:13: 00000100:00100000:2.0:1785787514.292733:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787514.293065:0:8140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769972608 00000100:00100000:3.0:1785787514.293073:0:8140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769972608 00000100:00100000:3.0:1785787514.293121:0:8140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1785787514.293129:0:8140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533769972608:12345-0@lo:13: 00002000:00000024:3.0:1785787514.293157:0:8140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785787514.293202:0:8140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533769972608:12345-0@lo:13: Request processed in 73us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787514.293209:0:8140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1785787514.293689:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1785787514.293724:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907fe17100 x1872533769972608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787530 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787514.293741:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fe17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533769972608:0@lo:13: 00010000:00010000:3.0:1785787514.359643:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787515.011639:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787515.011689:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787515.011853:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744783488 00000100:00100000:0.0:1785787515.011862:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744783488 00000100:00100000:0.0:1785787515.011937:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 31 00000100:00100000:0.0:1785787515.011948:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+6:2389:x1872533744783488:12345-192.168.203.53@tcp:400: 00000100:00100000:0.0:1785787515.012017:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+6:2389:x1872533744783488:12345-192.168.203.53@tcp:400: Request processed in 71us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787515.012025:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 31 00000100:00080000:0.0:1785787515.012047:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785787515.012476:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744783744 00000100:00100000:1.0:1785787515.012481:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744783744 00000100:00100000:1.0:1785787515.012536:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 14 00000100:00100000:1.0:1785787515.012543:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b375500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+5:2389:x1872533744783744:12345-192.168.203.53@tcp:400: 00000100:00100000:1.0:1785787515.012581:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b375500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+5:2389:x1872533744783744:12345-192.168.203.53@tcp:400: Request processed in 38us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787515.012588:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 14 00000100:00100000:3.0:1785787515.012848:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787515.012879:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787515.013113:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744783616 00000100:00100000:3.0:1785787515.013117:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744783616 00000100:00100000:3.0:1785787515.013147:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 15 00000100:00100000:3.0:1785787515.013154:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b377b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:79280304-55c6-4698-bfc3-29d14648ba45+5:2389:x1872533744783616:12345-192.168.203.53@tcp:400: 00000100:00100000:3.0:1785787515.013986:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b377b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:79280304-55c6-4698-bfc3-29d14648ba45+5:2389:x1872533744783616:12345-192.168.203.53@tcp:400: Request processed in 830us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787515.013994:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 15 00000100:00100000:1.0:1785787515.014149:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744783360 00000100:00100000:1.0:1785787515.014155:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744783360 00000100:00100000:1.0:1785787515.014203:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 133 00000100:00100000:1.0:1785787515.014210:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051582450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:2389:x1872533744783360:12345-192.168.203.53@tcp:400: 00000100:00100000:1.0:1785787515.014248:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051582450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:2389:x1872533744783360:12345-192.168.203.53@tcp:400: Request processed in 38us (2520us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787515.014255:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 133 00000100:00080000:0.0:1785787515.015116:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785787515.015121:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1785787515.382245:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1785787516.240302:0:8326:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcab2dffc0 20000000:00000080:0.0:1785787516.240317:0:8326:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91905c455000 uarg=0000000000000000 20000000:01000000:0.0:1785787516.240349:0:8326:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1785787516.240351:0:8326:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1785787516.240354:0:8326:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1785787516.240358:0:8326:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1785787516.240362:0:8326:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1785787516.240375:0:8326:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1785787516.240378:0:8326:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1785787516.240570:0:8326:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1785787516.240584:0:8326:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1785787516.251555:0:8327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1785787516.252175:0:8326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1785787516.252228:0:8326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1785787516.252259:0:8326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1785787516.252277:0:8326:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1785787516.252279:0:8326:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1785787516.255966:0:8328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1785787516.258069:0:8326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1785787516.258112:0:8326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1785787516.258155:0:8326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1785787516.258182:0:8326:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1785787516.258185:0:8326:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1785787516.259696:0:8329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1785787516.260102:0:8326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1785787516.260150:0:8326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1785787516.260199:0:8326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1785787516.260210:0:8326:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1785787516.260212:0:8326:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1785787516.262229:0:8330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1785787516.263000:0:8326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1785787516.263050:0:8326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1785787516.263082:0:8326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:0.0:1785787516.263094:0:8326:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1785787516.263111:0:8326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff919050679e00/0xe2c2ff68a6e84469 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787516.263129:0:8326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9190413a1400/0xe2c2ff68a6e84366 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e8435f expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787516.263137:0:8326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9190413a0600/0xe2c2ff68a6e84390 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e84389 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787516.263145:0:8326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91905f903000/0xe2c2ff68a6e843ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e843b3 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787516.263151:0:8326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919040031800/0xe2c2ff68a6e843c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e843c1 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787516.263908:0:8326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919040030400/0xe2c2ff68a6e843d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e843cf expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787516.263916:0:8326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919043c0e800/0xe2c2ff68a6e843f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e843eb expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787516.263923:0:8326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919043c0f800/0xe2c2ff68a6e8441c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e84415 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787516.263943:0:8326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919050679600/0xe2c2ff68a6e8442a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd1e2 expref: 9 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787516.263951:0:8326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91905f903400/0xe2c2ff68a6e84431 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd1e9 expref: 9 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787516.263958:0:8326:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff919050679e00/0xe2c2ff68a6e84469 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787516.274303:0:8326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91905f903400/0xe2c2ff68a6e84431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd1e9 expref: 9 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787516.274326:0:8326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91905f903400/0xe2c2ff68a6e84431 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd1e9 expref: 9 pid: 5813 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787516.274343:0:8326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8326:1872533769972736:192.168.203.53@tcp:104: 00010000:00010000:1.0:1785787516.274448:0:8326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919050679600/0xe2c2ff68a6e8442a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd1e2 expref: 9 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787516.274464:0:8326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff919050679600/0xe2c2ff68a6e8442a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd1e2 expref: 9 pid: 5814 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787516.274474:0:8326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8326:1872533769972864:192.168.203.53@tcp:104: 00010000:00010000:1.0:1785787516.274501:0:8326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919043c0f800/0xe2c2ff68a6e8441c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2c2ff68a6e84415 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787516.274517:0:8326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919043c0f800/0xe2c2ff68a6e8441c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2c2ff68a6e84415 expref: 18 pid: 5814 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787516.274526:0:8326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8326:1872533769972992:0@lo:104: 00000100:00100000:1.0:1785787516.275284:0:8326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1785787516.275336:0:8326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919043c0e800/0xe2c2ff68a6e843f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2c2ff68a6e843eb expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787516.275346:0:8326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919043c0e800/0xe2c2ff68a6e843f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2c2ff68a6e843eb expref: 18 pid: 5812 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787516.275354:0:8326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8326:1872533769973120:0@lo:104: 00000100:00100000:1.0:1785787516.275377:0:8326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1785787516.275412:0:8326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919040030400/0xe2c2ff68a6e843d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2c2ff68a6e843cf expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787516.275420:0:8326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919040030400/0xe2c2ff68a6e843d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2c2ff68a6e843cf expref: 18 pid: 5814 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787516.275429:0:8326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8326:1872533769973248:0@lo:104: 00010000:00010000:1.0:1785787516.275449:0:8326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919040031800/0xe2c2ff68a6e843c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2c2ff68a6e843c1 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787516.275465:0:8326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919040031800/0xe2c2ff68a6e843c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2c2ff68a6e843c1 expref: 18 pid: 5812 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787516.275474:0:8326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8326:1872533769973376:0@lo:104: 00010000:00010000:1.0:1785787516.275492:0:8326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91905f903000/0xe2c2ff68a6e843ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2c2ff68a6e843b3 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787516.275500:0:8326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91905f903000/0xe2c2ff68a6e843ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2c2ff68a6e843b3 expref: 18 pid: 5814 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787516.275507:0:8326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8326:1872533769973504:0@lo:104: 00000100:00100000:0.0:1785787516.275610:0:5803:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1785787516.275626:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787516.275638:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787516.275655:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769972992 00000100:00100000:0.0:1785787516.275660:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769972992 00000100:00100000:0.0:1785787516.275693:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769973120 00000100:00100000:0.0:1785787516.275695:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769973120 00000100:00100000:0.0:1785787516.275703:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769973248 00000100:00100000:0.0:1785787516.275705:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769973248 00000100:00100000:0.0:1785787516.275711:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769973376 00000100:00100000:0.0:1785787516.275714:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769973376 00000100:00100000:0.0:1785787516.275724:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1785787516.275730:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8642023-9103-4dbf-85d1-f204189bc871+6:8326:x1872533769972992:12345-0@lo:104: 00010000:00010000:0.0:1785787516.275743:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff919043c0fa00/0xe2c2ff68a6e84415 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e8441c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787516.275781:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1785787516.275786:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8642023-9103-4dbf-85d1-f204189bc871+6:8326:x1872533769972992:12345-0@lo:104: Request processed in 57us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787516.275793:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1785787516.275815:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1785787516.275820:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905c455450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8642023-9103-4dbf-85d1-f204189bc871+5:8326:x1872533769973120:12345-0@lo:104: 00010000:00010000:0.0:1785787516.275849:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff919040030200/0xe2c2ff68a6e843eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e843f2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787516.275882:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1785787516.275887:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905c455450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8642023-9103-4dbf-85d1-f204189bc871+5:8326:x1872533769973120:12345-0@lo:104: Request processed in 67us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787516.275893:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1785787516.275928:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1785787516.275935:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076edc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8642023-9103-4dbf-85d1-f204189bc871+4:8326:x1872533769973248:12345-0@lo:104: 00010000:00010000:0.0:1785787516.275942:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff919040030800/0xe2c2ff68a6e843cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e843d6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787516.275964:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1785787516.275969:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076edc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8642023-9103-4dbf-85d1-f204189bc871+4:8326:x1872533769973248:12345-0@lo:104: Request processed in 35us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787516.275974:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1785787516.275984:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1785787516.275989:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076edfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8642023-9103-4dbf-85d1-f204189bc871+3:8326:x1872533769973376:12345-0@lo:104: 00010000:00010000:0.0:1785787516.275996:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff919043c0ec00/0xe2c2ff68a6e843c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e843c8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787516.276015:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1785787516.276018:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076edfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8642023-9103-4dbf-85d1-f204189bc871+3:8326:x1872533769973376:12345-0@lo:104: Request processed in 30us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787516.276023:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1785787516.276043:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1785787516.276048:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff919043c0fa00/0xe2c2ff68a6e84415 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e8441c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787516.276056:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0fa00 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:0.0:1785787516.276060:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff919043c0fa00/0xe2c2ff68a6e84415 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2c2ff68a6e8441c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787516.276069:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff919043c0fa00/0xe2c2ff68a6e84415 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2c2ff68a6e8441c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1785787516.276076:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff919043c0fa00/0xe2c2ff68a6e84415 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2c2ff68a6e8441c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785787516.276082:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1785787516.276118:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff919043c0fa00/0xe2c2ff68a6e84415 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e8441c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787516.276125:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785787516.276137:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff919043c0fa00/0xe2c2ff68a6e84415 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e8441c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787516.276144:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff919043c0fa00/0xe2c2ff68a6e84415 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e8441c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787516.276156:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1785787516.276169:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff919040030200/0xe2c2ff68a6e843eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e843f2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787516.276175:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919040030200 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:0.0:1785787516.276178:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff919040030200/0xe2c2ff68a6e843eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2c2ff68a6e843f2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787516.276190:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff919040030200/0xe2c2ff68a6e843eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2c2ff68a6e843f2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1785787516.276197:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff919040030200/0xe2c2ff68a6e843eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2c2ff68a6e843f2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785787516.276202:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1785787516.276213:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff919040030200/0xe2c2ff68a6e843eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e843f2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787516.276218:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785787516.276223:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff919040030200/0xe2c2ff68a6e843eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e843f2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787516.276229:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff919040030200/0xe2c2ff68a6e843eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e843f2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787516.276238:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1785787516.276241:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff919040030800/0xe2c2ff68a6e843cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e843d6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787516.276247:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919040030800 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:0.0:1785787516.276250:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff919040030800/0xe2c2ff68a6e843cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2c2ff68a6e843d6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787516.276255:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff919040030800/0xe2c2ff68a6e843cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2c2ff68a6e843d6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1785787516.276262:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff919040030800/0xe2c2ff68a6e843cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2c2ff68a6e843d6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785787516.276271:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1785787516.276281:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff919040030800/0xe2c2ff68a6e843cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e843d6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787516.276286:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785787516.276297:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff919040030800/0xe2c2ff68a6e843cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e843d6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787516.276304:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff919040030800/0xe2c2ff68a6e843cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e843d6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787516.276312:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785787516.276315:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff919043c0ec00/0xe2c2ff68a6e843c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e843c8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787516.276320:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0ec00 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:0.0:1785787516.276323:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff919043c0ec00/0xe2c2ff68a6e843c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2c2ff68a6e843c8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787516.276330:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff919043c0ec00/0xe2c2ff68a6e843c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2c2ff68a6e843c8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1785787516.276337:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff919043c0ec00/0xe2c2ff68a6e843c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2c2ff68a6e843c8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785787516.276342:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1785787516.276353:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff919043c0ec00/0xe2c2ff68a6e843c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e843c8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787516.276358:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785787516.276369:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff919043c0ec00/0xe2c2ff68a6e843c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e843c8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787516.276376:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff919043c0ec00/0xe2c2ff68a6e843c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e843c8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787516.276384:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787516.276386:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787516.276387:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787516.276398:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076edd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533769974016:0@lo:103: 00000100:00100000:0.0:1785787516.276423:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787516.276446:0:3334:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785787516.276451:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533769973888:0@lo:103: 00000100:00100000:0.0:1785787516.276466:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1785787516.276925:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787516.276944:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769974016 00000100:00100000:3.0:1785787516.276948:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769974016 00010000:00010000:3.0:1785787516.276969:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919040031800/0xe2c2ff68a6e843c8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e843c1 expref: 19 pid: 5812 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787516.276989:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769973888 00000100:00100000:3.0:1785787516.276992:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769973888 00010000:00010000:3.0:1785787516.277000:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919040030400/0xe2c2ff68a6e843d6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e843cf expref: 20 pid: 5814 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787516.277011:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1785787516.277016:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ede680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d8642023-9103-4dbf-85d1-f204189bc871+20:3334:x1872533769974016:12345-0@lo:103: 00010000:00010000:3.0:1785787516.277024:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787516.277028:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919040031800/0xe2c2ff68a6e843c8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e843c1 expref: 20 pid: 5812 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787516.277037:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919040031800/0xe2c2ff68a6e843c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2c2ff68a6e843c1 expref: 20 pid: 5812 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787516.277052:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787516.277080:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ede680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d8642023-9103-4dbf-85d1-f204189bc871+20:3334:x1872533769974016:12345-0@lo:103: Request processed in 64us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787516.277086:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1785787516.277097:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1785787516.277103:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076edce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d8642023-9103-4dbf-85d1-f204189bc871+19:3334:x1872533769973888:12345-0@lo:103: 00010000:00010000:3.0:1785787516.277109:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787516.277113:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919040030400/0xe2c2ff68a6e843d6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e843cf expref: 19 pid: 5814 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787516.277131:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919040030400/0xe2c2ff68a6e843d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2c2ff68a6e843cf expref: 19 pid: 5814 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787516.277141:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787516.277170:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076edce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d8642023-9103-4dbf-85d1-f204189bc871+19:3334:x1872533769973888:12345-0@lo:103: Request processed in 68us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787516.277176:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1785787516.277206:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533769973888:0@lo:103: 00000100:00100000:3.0:1785787516.277213:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076edd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533769974016:0@lo:103: 00000100:00100000:1.0:1785787516.277329:0:8326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1785787516.277370:0:8326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9190413a0600/0xe2c2ff68a6e84390 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2c2ff68a6e84389 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787516.277379:0:8326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9190413a0600/0xe2c2ff68a6e84390 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2c2ff68a6e84389 expref: 18 pid: 5812 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787516.277444:0:8326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8326:1872533769974144:0@lo:104: 00000100:00100000:1.0:1785787516.277800:0:8326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1785787516.277934:0:8326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9190413a1400/0xe2c2ff68a6e84366 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2c2ff68a6e8435f expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787516.277943:0:8326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9190413a1400/0xe2c2ff68a6e84366 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2c2ff68a6e8435f expref: 18 pid: 5813 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787516.277951:0:8326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8326:1872533769974272:0@lo:104: 00000100:00100000:1.0:1785787516.277974:0:8326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787516.277983:0:8326:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190507eab40 going to sleep for 11 seconds 00000100:00100000:1.0:1785787516.277994:0:8326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8326:1872533769972992:0@lo:104: 00000100:00100000:1.0:1785787516.278001:0:8326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8326:1872533769973120:0@lo:104: 00010000:00010000:1.0:1785787516.278008:0:8326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919040030400/0xe2c2ff68a6e843d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2c2ff68a6e843cf expref: 18 pid: 5814 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787516.278017:0:8326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8326:1872533769973248:0@lo:104: 00010000:00010000:1.0:1785787516.278024:0:8326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919040031800/0xe2c2ff68a6e843c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2c2ff68a6e843c1 expref: 17 pid: 5812 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787516.278032:0:8326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8326:1872533769973376:0@lo:104: 00000100:00100000:3.0:1785787516.280546:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769973504 00000100:00100000:3.0:1785787516.280557:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769973504 00000100:00100000:3.0:1785787516.281034:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769974144 00000100:00100000:3.0:1785787516.281038:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769974144 00000100:00100000:3.0:1785787516.281049:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769974272 00000100:00100000:3.0:1785787516.281051:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769974272 00000100:00100000:3.0:1785787516.281064:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1785787516.281071:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8642023-9103-4dbf-85d1-f204189bc871+5:8326:x1872533769973504:12345-0@lo:104: 00010000:00010000:3.0:1785787516.281084:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff919043c0ee00/0xe2c2ff68a6e843b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e843ba expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787516.281147:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1785787516.281153:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8642023-9103-4dbf-85d1-f204189bc871+5:8326:x1872533769973504:12345-0@lo:104: Request processed in 83us (3825us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787516.281218:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1785787516.281233:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1785787516.281239:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8642023-9103-4dbf-85d1-f204189bc871+4:8326:x1872533769974144:12345-0@lo:104: 00010000:00010000:3.0:1785787516.281246:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff919043c0ea00/0xe2c2ff68a6e84389 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e84390 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787516.281288:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1785787516.281293:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8642023-9103-4dbf-85d1-f204189bc871+4:8326:x1872533769974144:12345-0@lo:104: Request processed in 55us (3493us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787516.281299:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1785787516.281311:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1785787516.281317:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8642023-9103-4dbf-85d1-f204189bc871+3:8326:x1872533769974272:12345-0@lo:104: 00010000:00010000:3.0:1785787516.281324:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff9190413a0e00/0xe2c2ff68a6e8435f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e84366 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787516.281349:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1785787516.281354:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8642023-9103-4dbf-85d1-f204189bc871+3:8326:x1872533769974272:12345-0@lo:104: Request processed in 38us (3380us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787516.281360:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1785787516.281521:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076edea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8642023-9103-4dbf-85d1-f204189bc871:3335:1872533769973632:0@lo:103: 00000100:00100000:2.0:1785787516.281565:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787516.281812:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785787516.281819:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076edc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8642023-9103-4dbf-85d1-f204189bc871:3335:1872533769973760:0@lo:103: 00000100:00100000:2.0:1785787516.281875:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787516.281905:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769973632 00000100:00100000:2.0:1785787516.281908:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769973632 00010000:00010000:2.0:1785787516.281928:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919043c0f800/0xe2c2ff68a6e8441c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e84415 expref: 17 pid: 5814 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787516.281942:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769973760 00000100:00100000:2.0:1785787516.281945:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769973760 00010000:00010000:2.0:1785787516.281955:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919043c0e800/0xe2c2ff68a6e843f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e843eb expref: 18 pid: 5812 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787516.281965:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1785787516.281970:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8642023-9103-4dbf-85d1-f204189bc871+18:3335:x1872533769973632:12345-0@lo:103: 00010000:00010000:2.0:1785787516.281979:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785787516.281985:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919043c0f800/0xe2c2ff68a6e8441c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e84415 expref: 18 pid: 5814 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787516.281994:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919043c0f800/0xe2c2ff68a6e8441c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2c2ff68a6e84415 expref: 18 pid: 5814 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787516.282014:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919043c0f800/0xe2c2ff68a6e8441c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2c2ff68a6e84415 expref: 18 pid: 5814 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787516.282027:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785787516.282053:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8642023-9103-4dbf-85d1-f204189bc871+17:3335:x1872533769973632:12345-0@lo:103: Request processed in 82us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787516.282059:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1785787516.282073:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1785787516.282078:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8642023-9103-4dbf-85d1-f204189bc871+16:3335:x1872533769973760:12345-0@lo:103: 00010000:00010000:2.0:1785787516.282085:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785787516.282088:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919043c0e800/0xe2c2ff68a6e843f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e843eb expref: 16 pid: 5812 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787516.282096:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919043c0e800/0xe2c2ff68a6e843f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2c2ff68a6e843eb expref: 16 pid: 5812 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787516.282105:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919043c0e800/0xe2c2ff68a6e843f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2c2ff68a6e843eb expref: 16 pid: 5812 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787516.282114:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785787516.282130:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8642023-9103-4dbf-85d1-f204189bc871+15:3335:x1872533769973760:12345-0@lo:103: Request processed in 53us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787516.282136:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1785787516.282233:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076edc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8642023-9103-4dbf-85d1-f204189bc871:3335:1872533769973760:0@lo:103: 00000100:00100000:2.0:1785787516.282241:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076edea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8642023-9103-4dbf-85d1-f204189bc871:3335:1872533769973632:0@lo:103: 00000100:00100000:1.0:1785787516.283007:0:8326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8326:1872533769973504:0@lo:104: 00000100:00100000:1.0:1785787516.283016:0:8326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8326:1872533769974144:0@lo:104: 00000100:00100000:1.0:1785787516.283029:0:8326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8326:1872533769974272:0@lo:104: 00000100:00100000:3.0:1785787516.283126:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787516.283146:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787516.283249:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744783872 00000100:00100000:0.0:1785787516.283253:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744783872 00010000:00010000:0.0:1785787516.283272:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919050679600/0xe2c2ff68a6e8442a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd1e2 expref: 10 pid: 5814 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787516.283283:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744784000 00000100:00100000:0.0:1785787516.283285:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744784000 00010000:00010000:0.0:1785787516.283294:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91905f903400/0xe2c2ff68a6e84431 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd1e9 expref: 11 pid: 5813 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787516.283306:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 16 00000100:00100000:0.0:1785787516.283311:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b377800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+11:2390:x1872533744783872:12345-192.168.203.53@tcp:103: 00010000:00010000:0.0:1785787516.283320:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785787516.283324:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919050679600/0xe2c2ff68a6e8442a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd1e2 expref: 11 pid: 5814 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787516.283344:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919050679600/0xe2c2ff68a6e8442a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd1e2 expref: 11 pid: 5814 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787516.283355:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785787516.283396:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b377800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+11:2390:x1872533744783872:12345-192.168.203.53@tcp:103: Request processed in 74us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787516.283403:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 16 00000100:00100000:0.0:1785787516.283417:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 17 00000100:00100000:0.0:1785787516.283423:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b376a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:2390:x1872533744784000:12345-192.168.203.53@tcp:103: 00010000:00010000:0.0:1785787516.283430:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785787516.283434:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91905f903400/0xe2c2ff68a6e84431 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd1e9 expref: 10 pid: 5813 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787516.283444:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91905f903400/0xe2c2ff68a6e84431 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd1e9 expref: 10 pid: 5813 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787516.283462:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785787516.283477:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b376a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:2390:x1872533744784000:12345-192.168.203.53@tcp:103: Request processed in 54us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787516.283483:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 17 00010000:00010000:3.0:1785787516.284344:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1785787516.284350:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff919043c0ee00/0xe2c2ff68a6e843b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e843ba expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787516.284358:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0ee00 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:3.0:1785787516.284361:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff919043c0ee00/0xe2c2ff68a6e843b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2c2ff68a6e843ba expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787516.284369:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff919043c0ee00/0xe2c2ff68a6e843b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2c2ff68a6e843ba expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785787516.284377:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff919043c0ee00/0xe2c2ff68a6e843b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2c2ff68a6e843ba expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785787516.286239:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1785787516.286276:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff919043c0ee00/0xe2c2ff68a6e843b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e843ba expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787516.286283:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785787516.286298:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff919043c0ee00/0xe2c2ff68a6e843b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e843ba expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787516.286305:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff919043c0ee00/0xe2c2ff68a6e843b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e843ba expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787516.286316:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1785787516.286320:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff919043c0ea00/0xe2c2ff68a6e84389 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e84390 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787516.286326:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0ea00 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:3.0:1785787516.286329:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff919043c0ea00/0xe2c2ff68a6e84389 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2c2ff68a6e84390 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787516.286336:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff919043c0ea00/0xe2c2ff68a6e84389 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2c2ff68a6e84390 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785787516.286343:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff919043c0ea00/0xe2c2ff68a6e84389 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2c2ff68a6e84390 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785787516.286348:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1785787516.286360:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff919043c0ea00/0xe2c2ff68a6e84389 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e84390 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787516.286366:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785787516.286378:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff919043c0ea00/0xe2c2ff68a6e84389 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e84390 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787516.288070:0:8326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91905f903400/0xe2c2ff68a6e84431 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd1e9 expref: 9 pid: 5813 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787516.288084:0:8326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8326:1872533769972736:192.168.203.53@tcp:104: 00010000:00010000:1.0:1785787516.288096:0:8326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919050679600/0xe2c2ff68a6e8442a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd1e2 expref: 8 pid: 5814 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787516.288105:0:8326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8326:1872533769972864:192.168.203.53@tcp:104: 00010000:00010000:1.0:1785787516.288144:0:8326:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff919050679e00/0xe2c2ff68a6e84469 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787516.288303:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff919043c0ea00/0xe2c2ff68a6e84389 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e84390 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787516.288314:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785787516.288318:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff9190413a0e00/0xe2c2ff68a6e8435f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e84366 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787516.288324:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413a0e00 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:3.0:1785787516.288328:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff9190413a0e00/0xe2c2ff68a6e8435f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2c2ff68a6e84366 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787516.288335:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff9190413a0e00/0xe2c2ff68a6e8435f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2c2ff68a6e84366 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785787516.288342:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff9190413a0e00/0xe2c2ff68a6e8435f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2c2ff68a6e84366 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785787516.288348:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1785787516.288370:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff9190413a0e00/0xe2c2ff68a6e8435f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e84366 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787516.288375:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1785787516.288498:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8642023-9103-4dbf-85d1-f204189bc871:3336:1872533769974528:0@lo:103: 00000100:00100000:2.0:1785787516.288785:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787516.288839:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785787516.288845:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8642023-9103-4dbf-85d1-f204189bc871:3336:1872533769974400:0@lo:103: 00000100:00100000:2.0:1785787516.288868:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787516.288888:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769974528 00000100:00100000:2.0:1785787516.288893:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769974528 00010000:00010000:2.0:1785787516.288914:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9190413a0600/0xe2c2ff68a6e84390 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e84389 expref: 15 pid: 5812 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787516.288934:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769974400 00000100:00100000:2.0:1785787516.288937:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769974400 00010000:00010000:2.0:1785787516.288947:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91905f903000/0xe2c2ff68a6e843ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e843b3 expref: 16 pid: 5814 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787516.288959:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1785787516.288966:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051467450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8642023-9103-4dbf-85d1-f204189bc871+16:3336:x1872533769974528:12345-0@lo:103: 00010000:00010000:2.0:1785787516.288975:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785787516.288979:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9190413a0600/0xe2c2ff68a6e84390 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e84389 expref: 16 pid: 5812 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787516.288989:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9190413a0600/0xe2c2ff68a6e84390 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2c2ff68a6e84389 expref: 16 pid: 5812 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787516.289001:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9190413a0600/0xe2c2ff68a6e84390 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2c2ff68a6e84389 expref: 16 pid: 5812 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787516.289011:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785787516.289037:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051467450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8642023-9103-4dbf-85d1-f204189bc871+15:3336:x1872533769974528:12345-0@lo:103: Request processed in 72us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787516.289043:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1785787516.289084:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1785787516.289089:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8642023-9103-4dbf-85d1-f204189bc871+14:3336:x1872533769974400:12345-0@lo:103: 00010000:00010000:2.0:1785787516.289095:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785787516.289099:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91905f903000/0xe2c2ff68a6e843ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e843b3 expref: 14 pid: 5814 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787516.289108:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91905f903000/0xe2c2ff68a6e843ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2c2ff68a6e843b3 expref: 14 pid: 5814 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787516.289118:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91905f903000/0xe2c2ff68a6e843ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2c2ff68a6e843b3 expref: 14 pid: 5814 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787516.289125:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785787516.289142:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8642023-9103-4dbf-85d1-f204189bc871+13:3336:x1872533769974400:12345-0@lo:103: Request processed in 53us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787516.289148:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1785787516.289229:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8642023-9103-4dbf-85d1-f204189bc871:3336:1872533769974400:0@lo:103: 00000100:00100000:2.0:1785787516.289237:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8642023-9103-4dbf-85d1-f204189bc871:3336:1872533769974528:0@lo:103: 00010000:00010000:3.0:1785787516.289874:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff9190413a0e00/0xe2c2ff68a6e8435f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e84366 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787516.289882:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff9190413a0e00/0xe2c2ff68a6e8435f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e84366 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787516.289896:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787516.289904:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787516.289905:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787516.289921:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785787516.290915:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533769974656:0@lo:103: 00000100:00100000:2.0:1785787516.290945:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787516.291090:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769974656 00000100:00100000:3.0:1785787516.291095:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769974656 00010000:00010000:3.0:1785787516.291113:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9190413a1400/0xe2c2ff68a6e84366 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e8435f expref: 13 pid: 5813 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787516.291139:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1785787516.291145:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8642023-9103-4dbf-85d1-f204189bc871+13:3333:x1872533769974656:12345-0@lo:103: 00010000:00010000:3.0:1785787516.291152:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787516.291166:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9190413a1400/0xe2c2ff68a6e84366 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e8435f expref: 13 pid: 5813 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787516.291176:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9190413a1400/0xe2c2ff68a6e84366 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2c2ff68a6e8435f expref: 13 pid: 5813 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787516.291186:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9190413a1400/0xe2c2ff68a6e84366 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2c2ff68a6e8435f expref: 13 pid: 5813 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787516.291198:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff919050679e00/0xe2c2ff68a6e84469 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787516.291206:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919050679e00/0xe2c2ff68a6e84469 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787516.291218:0:5807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919050679e00/0xe2c2ff68a6e84469 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787516.291225:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919050679e00/0xe2c2ff68a6e84469 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787516.291241:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff919050679e00/0xe2c2ff68a6e84469 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787516.291248:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff919050679e00/0xe2c2ff68a6e84469 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787516.291254:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919050679e00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:3.0:1785787516.291258:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff919050679e00/0xe2c2ff68a6e84469 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787516.291265:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff919050679e00/0xe2c2ff68a6e84469 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787516.291276:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff919050679e00/0xe2c2ff68a6e84469 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787516.291284:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787516.291312:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8642023-9103-4dbf-85d1-f204189bc871+12:3333:x1872533769974656:12345-0@lo:103: Request processed in 167us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787516.291318:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1785787516.291420:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533769974656:0@lo:103: 00010000:00010000:1.0:1785787516.292243:0:8326:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff919050679e00/0xe2c2ff68a6e84469 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787516.292253:0:8326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff919050679e00/0xe2c2ff68a6e84469 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787516.292259:0:8326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919050679e00/0xe2c2ff68a6e84469 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787516.404549:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787516.866774:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fe15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3335:1872533769974912:0@lo:400: 00000100:00100000:3.0:1785787516.866857:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787516.866968:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fe15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533769975168:0@lo:400: 00000100:00100000:2.0:1785787516.867002:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787516.867030:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fe14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533769974784:0@lo:400: 00000100:00100000:2.0:1785787516.867063:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fe17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3336:1872533769975040:0@lo:400: 00000100:00100000:1.0:1785787516.867069:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787516.867096:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fe17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3334:1872533769975296:0@lo:400: 00000100:00100000:2.0:1785787516.867108:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787516.867136:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787516.867141:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785787516.867156:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fe14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769975424:0@lo:400: 00000100:00100000:2.0:1785787516.867184:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787516.867294:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769975168 00000100:00100000:1.0:1785787516.867302:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769975168 00000100:00100000:1.0:1785787516.867354:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769975424 00000100:00100000:1.0:1785787516.867362:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769975424 00000100:00100000:1.0:1785787516.867380:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1785787516.867387:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533769975168:12345-0@lo:400: 00000100:00100000:1.0:1785787516.867434:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533769975168:12345-0@lo:400: Request processed in 47us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787516.867441:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1785787516.867455:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1785787516.867460:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905267f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769975424:12345-0@lo:400: 00000100:00100000:1.0:1785787516.867487:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905267f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769975424:12345-0@lo:400: Request processed in 27us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787516.867492:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1785787516.867520:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907fe15c00 x1872533769975168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787516.867544:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fe15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533769975168:0@lo:400: 00010000:00080000:1.0:1785787516.867569:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907fe14380 x1872533769975424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787516.867579:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fe14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769975424:0@lo:400: 00000100:00100000:1.0:1785787516.870751:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769974912 00000100:00100000:1.0:1785787516.870761:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769974912 00000100:00100000:1.0:1785787516.870794:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769975040 00000100:00100000:1.0:1785787516.870796:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769975040 00000100:00100000:1.0:1785787516.870808:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769975296 00000100:00100000:1.0:1785787516.870810:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769975296 00000100:00100000:1.0:1785787516.870824:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1785787516.870846:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3335:x1872533769974912:12345-0@lo:400: 00000100:00100000:1.0:1785787516.870914:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3335:x1872533769974912:12345-0@lo:400: Request processed in 69us (4057us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787516.870933:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1785787516.870946:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1785787516.870951:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905267d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3336:x1872533769975040:12345-0@lo:400: 00000100:00100000:1.0:1785787516.870985:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905267d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3336:x1872533769975040:12345-0@lo:400: Request processed in 34us (3878us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787516.870990:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1785787516.871000:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1785787516.871005:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3334:x1872533769975296:12345-0@lo:400: 00000100:00100000:1.0:1785787516.871032:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3334:x1872533769975296:12345-0@lo:400: Request processed in 28us (3898us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787516.871038:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1785787516.871066:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fe17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3336:1872533769975040:0@lo:400: 00000100:00100000:1.0:1785787516.871091:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fe17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3334:1872533769975296:0@lo:400: 00000100:00080000:2.0:1785787516.871206:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1785787516.871210:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785787516.871213:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785787516.873398:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fe15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3335:1872533769974912:0@lo:400: 00000100:00100000:3.0:1785787516.873427:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769974784 00000100:00100000:3.0:1785787516.873432:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769974784 00000100:00100000:3.0:1785787516.873523:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1785787516.873532:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051580c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+12:3334:x1872533769974784:12345-0@lo:400: 00000100:00100000:3.0:1785787516.876213:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051580c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+12:3334:x1872533769974784:12345-0@lo:400: Request processed in 2679us (9142us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787516.876223:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1785787516.885433:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fe14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533769974784:0@lo:400: 00000100:00100000:1.0:1785787517.363866:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769975552:0@lo:13: 00000100:00100000:1.0:1785787517.363964:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787517.364077:0:6621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769975552 00000100:00100000:2.0:1785787517.364092:0:6621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769975552 00000100:00100000:2.0:1785787517.364164:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1785787517.364173:0:6621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769975552:12345-0@lo:13: 00002000:00000024:2.0:1785787517.364212:0:6621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785787517.364300:0:6621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769975552:12345-0@lo:13: Request processed in 128us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787517.364307:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1785787517.364566:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076ede300 x1872533769975552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787533 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787517.364598:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769975552:0@lo:13: 00010000:00010000:3.0:1785787517.428632:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1785787517.490986:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1785787517.490995:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91907fddf800 from 39 10000000:01000000:0.0:1785787517.491002:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1785787517.491060:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff919050678400/0xe2c2ff68a6e84470 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787517.491074:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff919050678400/0xe2c2ff68a6e84470 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787517.491108:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff919050678400/0xe2c2ff68a6e84470 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787517.491138:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076edf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769975680:0@lo:101: 00000100:00100000:0.0:1785787517.491371:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787517.491464:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190774210c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785787517.492005:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769975680 00000100:00100000:3.0:1785787517.492015:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769975680 00000100:00100000:3.0:1785787517.492088:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1785787517.492099:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+12:5818:x1872533769975680:12345-0@lo:101: 00010000:00010000:3.0:1785787517.492116:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787517.492135:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91905f902000/0xe2c2ff68a6e84477 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e84470 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787517.492163:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91905f902000/0xe2c2ff68a6e84477 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e84470 expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787517.492175:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91905f902000/0xe2c2ff68a6e84477 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e84470 expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787517.492185:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f902000, rc 0) 00000100:00100000:3.0:1785787517.492470:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+13:5818:x1872533769975680:12345-0@lo:101: Request processed in 372us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787517.492478:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1785787517.492772:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076edf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769975680:0@lo:101: 00010000:00010000:0.0:1785787517.492801:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff919050678400/0xe2c2ff68a6e84470 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84477 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787517.492812:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff919050678400/0xe2c2ff68a6e84470 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e84477 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787517.492915:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076edf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769975808:0@lo:501: 00000100:00100000:0.0:1785787517.492948:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787517.492988:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190774210c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785787517.493691:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769975808 00000100:00100000:3.0:1785787517.493697:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769975808 00000100:00100000:3.0:1785787517.493738:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1785787517.493748:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+13:5818:x1872533769975808:12345-0@lo:501: 00000100:00100000:3.0:1785787517.494213:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+13:5818:x1872533769975808:12345-0@lo:501: Request processed in 466us (1263us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787517.494358:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1785787517.494474:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076edf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769975808:0@lo:501: 00000100:00100000:0.0:1785787517.494513:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076edf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769975936:0@lo:503: 00000100:00100000:0.0:1785787517.494632:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787517.494667:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190774210c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785787517.494846:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769975936 00000100:00100000:3.0:1785787517.494851:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769975936 00000100:00100000:3.0:1785787517.494914:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1785787517.494922:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+13:5818:x1872533769975936:12345-0@lo:503: 00000100:00100000:3.0:1785787517.495083:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+13:5818:x1872533769975936:12345-0@lo:503: Request processed in 161us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787517.495089:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1785787517.495152:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076edf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769975936:0@lo:503: 00000100:00100000:0.0:1785787517.499928:0:8342:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076edf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:8342:1872533769976064:0@lo:502: 00000100:00100000:0.0:1785787517.500027:0:8342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787517.516925:0:8342:0:(client.c:2702:ptlrpc_set_wait()) set ffff919077421a80 going to sleep for 11 seconds 00000100:00100000:1.0:1785787517.520091:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769976064 00000100:00100000:1.0:1785787517.520107:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769976064 00000100:00100000:1.0:1785787517.520178:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1785787517.520187:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+13:8342:x1872533769976064:12345-0@lo:502: 00000100:00100000:1.0:1785787517.520887:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+13:8342:x1872533769976064:12345-0@lo:502: Request processed in 699us (20859us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787517.520895:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1785787517.521677:0:8342:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076edf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:8342:1872533769976064:0@lo:502: 00000100:00100000:0.0:1785787517.521759:0:8342:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076edf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:8342:1872533769976192:0@lo:502: 00000100:00100000:0.0:1785787517.521945:0:8342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787517.522038:0:8342:0:(client.c:2702:ptlrpc_set_wait()) set ffff919077421a80 going to sleep for 11 seconds 00000100:00100000:1.0:1785787517.523648:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769976192 00000100:00100000:1.0:1785787517.523658:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769976192 00000100:00100000:1.0:1785787517.523713:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1785787517.523723:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+13:8342:x1872533769976192:12345-0@lo:502: 00000100:00100000:1.0:1785787517.524315:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+13:8342:x1872533769976192:12345-0@lo:502: Request processed in 593us (2369us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787517.524324:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1785787517.524944:0:8342:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076edf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:8342:1872533769976192:0@lo:502: 00000040:00080000:0.0:1785787517.525037:0:8342:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1785787517.525316:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1785787517.525341:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1785787517.525355:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff919050678400/0xe2c2ff68a6e84470 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84477 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787517.525368:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff919050678400/0xe2c2ff68a6e84470 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84477 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785787517.525379:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1785787517.525382:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1785787517.525385:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1785787517.525422:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff91905f902400/0xe2c2ff68a6e8447e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787517.525431:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff91905f902400/0xe2c2ff68a6e8447e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787517.525442:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff91905f902400/0xe2c2ff68a6e8447e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787517.525461:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b376d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769976320:0@lo:101: 00000100:00100000:3.0:1785787517.526329:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787517.526370:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905159db40 going to sleep for 11 seconds 00000100:00100000:0.0:1785787517.526431:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769976320 00000100:00100000:0.0:1785787517.526437:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769976320 00000100:00100000:0.0:1785787517.526488:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1785787517.526497:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+13:5818:x1872533769976320:12345-0@lo:101: 00010000:00010000:0.0:1785787517.526511:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787517.526595:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919050679c00/0xe2c2ff68a6e84485 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e8447e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787517.526626:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919050679c00/0xe2c2ff68a6e84485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e8447e expref: 14 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787517.526650:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919050679c00/0xe2c2ff68a6e84485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e8447e expref: 14 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787517.526661:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919050679c00, rc 0) 00000100:00100000:0.0:1785787517.526709:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+14:5818:x1872533769976320:12345-0@lo:101: Request processed in 213us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787517.526716:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1785787517.527070:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b376d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769976320:0@lo:101: 00010000:00010000:3.0:1785787517.527086:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff91905f902400/0xe2c2ff68a6e8447e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84485 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787517.527096:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff91905f902400/0xe2c2ff68a6e8447e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e84485 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787517.527160:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b376d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769976448:0@lo:501: 00000100:00100000:3.0:1785787517.527191:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787517.527346:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905159db40 going to sleep for 11 seconds 00000100:00100000:0.0:1785787517.528800:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769976448 00000100:00100000:0.0:1785787517.528807:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769976448 00000100:00100000:0.0:1785787517.528855:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1785787517.528863:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+14:5818:x1872533769976448:12345-0@lo:501: 00000100:00100000:0.0:1785787517.529185:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+14:5818:x1872533769976448:12345-0@lo:501: Request processed in 322us (1993us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787517.529200:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1785787517.530998:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b376d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769976448:0@lo:501: 00000100:00100000:3.0:1785787517.531053:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b376d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769976576:0@lo:503: 00000100:00100000:3.0:1785787517.531106:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787517.531142:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905159db40 going to sleep for 11 seconds 00000100:00100000:0.0:1785787517.532673:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769976576 00000100:00100000:0.0:1785787517.532683:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769976576 00000100:00100000:0.0:1785787517.532744:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1785787517.532755:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+14:5818:x1872533769976576:12345-0@lo:503: 00000100:00100000:0.0:1785787517.533156:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+14:5818:x1872533769976576:12345-0@lo:503: Request processed in 403us (2049us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787517.533165:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1785787517.533919:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b376d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769976576:0@lo:503: 00000100:00100000:0.0:1785787517.534775:0:8343:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076edf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:8343:1872533769976704:0@lo:502: 00000100:00100000:0.0:1785787517.534852:0:8343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787517.535067:0:8343:0:(client.c:2702:ptlrpc_set_wait()) set ffff919077421240 going to sleep for 11 seconds 00000100:00100000:3.0:1785787517.535314:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769976704 00000100:00100000:3.0:1785787517.535320:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769976704 00000100:00100000:3.0:1785787517.535363:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1785787517.535372:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+14:8343:x1872533769976704:12345-0@lo:502: 00000100:00100000:2.0:1785787517.535754:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+14:8343:x1872533769976704:12345-0@lo:502: Request processed in 382us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787517.535762:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1785787517.536974:0:8343:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076edf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:8343:1872533769976704:0@lo:502: 00000020:01000000:3.0:1785787517.537006:0:8343:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1785787517.537018:0:8343:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785787517.537020:0:8343:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1785787517.537033:0:8343:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1785787517.537070:0:8343:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b376d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:8343:1872533769976832:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785787517.537108:0:8343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787517.537139:0:8343:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905159db40 going to sleep for 11 seconds 00000100:00100000:2.0:1785787517.537629:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769976832 00000100:00100000:2.0:1785787517.537634:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769976832 00000100:00100000:2.0:1785787517.537677:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1785787517.537685:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+14:8343:x1872533769976832:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785787517.538313:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+14:8343:x1872533769976832:12345-0@lo:502:llog_process_th.0 Request processed in 628us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787517.538321:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1785787517.538705:0:8343:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b376d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:8343:1872533769976832:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1785787517.538733:0:8343:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785787517.538739:0:8343:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785787517.538741:0:8343:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1785787517.538748:0:8343:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1785787517.539718:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1785787517.539743:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1785787517.539754:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff91905f902400/0xe2c2ff68a6e8447e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84485 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787517.539847:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff91905f902400/0xe2c2ff68a6e8447e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84485 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785787517.539859:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1785787517.539862:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff919048214000 from 39 10000000:01000000:2.0:1785787517.539865:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1785787517.539946:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff9190413a0600/0xe2c2ff68a6e8448c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787517.539954:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff9190413a0600/0xe2c2ff68a6e8448c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787517.540010:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff9190413a0600/0xe2c2ff68a6e8448c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787517.540029:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769976960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1785787517.540066:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787517.540098:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff918f42eee780 going to sleep for 11 seconds 00000100:00100000:1.0:1785787517.540329:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769976960 00000100:00100000:1.0:1785787517.540335:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769976960 00000100:00100000:2.0:1785787517.540462:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1785787517.540470:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+14:5818:x1872533769976960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785787517.540482:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787517.540497:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190413a1e00/0xe2c2ff68a6e84493 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e8448c expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787517.540534:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190413a1e00/0xe2c2ff68a6e84493 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e8448c expref: 15 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787517.540544:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190413a1e00/0xe2c2ff68a6e84493 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e8448c expref: 15 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787517.540559:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190413a1e00, rc 0) 00000100:00100000:2.0:1785787517.540596:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+15:5818:x1872533769976960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787517.540602:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1785787517.540668:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769976960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1785787517.540684:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff9190413a0600/0xe2c2ff68a6e8448c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84493 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787517.540693:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff9190413a0600/0xe2c2ff68a6e8448c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e84493 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787517.540742:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769977088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785787517.540766:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787517.549915:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190507eaa80 going to sleep for 11 seconds 00000100:00100000:2.0:1785787517.562921:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769977088 00000100:00100000:2.0:1785787517.562943:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769977088 00000100:00100000:2.0:1785787517.563036:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1785787517.563049:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+15:5818:x1872533769977088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1785787517.563762:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+15:5818:x1872533769977088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 715us (22992us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787517.563771:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1785787517.565893:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769977088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785787517.567328:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769977216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785787517.567427:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787517.567480:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190507eaa80 going to sleep for 11 seconds 00000100:00100000:3.0:1785787517.567653:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769977216 00000100:00100000:3.0:1785787517.567663:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769977216 00000100:00100000:3.0:1785787517.567724:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1785787517.567735:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+15:5818:x1872533769977216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785787517.568007:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+15:5818:x1872533769977216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 273us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787517.568015:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1785787517.568267:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769977216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1785787517.570487:0:8344:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:8344:1872533769977344:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785787517.570580:0:8344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787517.570621:0:8344:0:(client.c:2702:ptlrpc_set_wait()) set ffff918f42eee780 going to sleep for 11 seconds 00000100:00100000:3.0:1785787517.570894:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769977344 00000100:00100000:3.0:1785787517.570901:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769977344 00000100:00100000:3.0:1785787517.570955:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1785787517.571098:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+15:8344:x1872533769977344:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785787517.571437:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+15:8344:x1872533769977344:12345-0@lo:502:llog_process_th.0 Request processed in 344us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787517.571446:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1785787517.583716:0:8344:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:8344:1872533769977344:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785787517.585051:0:8344:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:8344:1872533769977472:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785787517.585440:0:8344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787517.585488:0:8344:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190490fc300 going to sleep for 11 seconds 00000100:00100000:3.0:1785787517.589275:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769977472 00000100:00100000:3.0:1785787517.589294:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769977472 00000100:00100000:3.0:1785787517.589366:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1785787517.589390:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+15:8344:x1872533769977472:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785787517.590483:0:8344:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:8344:1872533769977472:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1785787517.590547:0:8344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000100:00100000:3.0:1785787517.590806:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+15:8344:x1872533769977472:12345-0@lo:502:llog_process_th.0 Request processed in 1002us (4938us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787517.590854:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000020:01000000:0.0:1785787517.591137:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1785787517.591158:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1785787517.591170:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff9190413a0600/0xe2c2ff68a6e8448c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84493 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787517.591182:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff9190413a0600/0xe2c2ff68a6e8448c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84493 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785787517.591192:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1785787517.591195:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1785787517.591198:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1785787517.591249:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff919050679400/0xe2c2ff68a6e8449a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787517.591258:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff919050679400/0xe2c2ff68a6e8449a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787517.591275:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff919050679400/0xe2c2ff68a6e8449a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787517.591298:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076edf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769977600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1785787517.591340:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787517.591514:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190774210c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785787517.591628:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769977600 00000100:00100000:2.0:1785787517.591634:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769977600 00000100:00100000:2.0:1785787517.591688:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1785787517.591697:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+15:5818:x1872533769977600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785787517.591710:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787517.591726:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190413a0400/0xe2c2ff68a6e844a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e8449a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787517.591761:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190413a0400/0xe2c2ff68a6e844a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e8449a expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787517.591773:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190413a0400/0xe2c2ff68a6e844a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e8449a expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787517.591796:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190413a0400, rc 0) 00000100:00100000:2.0:1785787517.591860:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+16:5818:x1872533769977600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787517.591867:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1785787517.592053:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076edf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769977600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785787517.592068:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff919050679400/0xe2c2ff68a6e8449a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e844a1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787517.592078:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff919050679400/0xe2c2ff68a6e8449a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e844a1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787517.592143:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769977728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1785787517.592173:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787517.592188:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff919076bb00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785787517.592200:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769977728 00000100:00100000:2.0:1785787517.592203:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769977728 00000100:00100000:2.0:1785787517.592221:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1785787517.592227:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051538c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+16:5818:x1872533769977728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785787517.595312:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769977728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785787517.595394:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b376d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769977856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785787517.611153:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787517.611219:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905159d240 going to sleep for 11 seconds 00000100:00100000:0.0:1785787517.611394:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769977856 00000100:00100000:0.0:1785787517.611404:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769977856 00000100:00100000:0.0:1785787517.611466:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1785787517.611476:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+17:5818:x1872533769977856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785787517.611738:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+17:5818:x1872533769977856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 263us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787517.611746:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1785787517.615572:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b376d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769977856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785787517.619358:0:8345:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:8345:1872533769977984:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785787517.619486:0:8345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787517.619723:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769977984 00000100:00100000:0.0:1785787517.619733:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769977984 00000100:00100000:0.0:1785787517.619791:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1785787517.619801:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051539c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+17:8345:x1872533769977984:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785787517.620100:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051539c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+17:8345:x1872533769977984:12345-0@lo:502:llog_process_th.0 Request processed in 299us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787517.620109:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1785787517.620325:0:8345:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190507eac00 going to sleep for 11 seconds 00000100:00100000:1.0:1785787517.620351:0:8345:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:8345:1872533769977984:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1785787517.620405:0:8345:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1785787517.620416:0:8345:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785787517.620419:0:8345:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1785787517.620424:0:8345:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1785787517.620446:0:8345:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:8345:1872533769978112:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785787517.620480:0:8345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787517.620505:0:8345:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190507eac00 going to sleep for 11 seconds 00000100:00100000:3.0:1785787517.621498:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769978112 00000100:00100000:3.0:1785787517.621506:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769978112 00000100:00100000:3.0:1785787517.621549:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1785787517.621558:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051539450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+17:8345:x1872533769978112:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785787517.621753:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051539450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+17:8345:x1872533769978112:12345-0@lo:502:llog_process_th.0 Request processed in 196us (1272us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787517.621761:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1785787517.622347:0:8345:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:8345:1872533769978112:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1785787517.622393:0:8345:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1785787517.622400:0:8345:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785787517.622402:0:8345:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1785787517.622407:0:8345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1785787517.624335:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1785787517.624367:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1785787517.624392:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff919050679400/0xe2c2ff68a6e8449a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e844a1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787517.624406:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff919050679400/0xe2c2ff68a6e8449a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e844a1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785787517.624419:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1785787517.624422:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff919056a98000 from 39 10000000:01000000:3.0:1785787517.624425:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1785787517.624471:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff91905f902200/0xe2c2ff68a6e844a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787517.624480:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff91905f902200/0xe2c2ff68a6e844a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787517.624505:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff91905f902200/0xe2c2ff68a6e844a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787517.624645:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b374700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769978240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1785787517.624711:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787517.624760:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905159d840 going to sleep for 11 seconds 00000100:00100000:0.0:1785787517.624858:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769978240 00000100:00100000:0.0:1785787517.624866:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769978240 00000100:00100000:0.0:1785787517.625310:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1785787517.625323:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+17:5818:x1872533769978240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785787517.625338:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787517.625362:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919050679000/0xe2c2ff68a6e844af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e844a8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787517.625454:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919050679000/0xe2c2ff68a6e844af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e844a8 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787517.625468:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919050679000/0xe2c2ff68a6e844af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e844a8 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787517.625478:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919050679000, rc 0) 00000100:00100000:0.0:1785787517.625726:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+18:5818:x1872533769978240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 405us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787517.625734:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1785787517.627418:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b374700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769978240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1785787517.627443:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff91905f902200/0xe2c2ff68a6e844a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e844af expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787517.627455:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff91905f902200/0xe2c2ff68a6e844a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e844af expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787517.627546:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769978368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785787517.627608:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787517.627656:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190507eac00 going to sleep for 11 seconds 00000100:00100000:1.0:1785787517.627676:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769978368 00000100:00100000:1.0:1785787517.627681:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769978368 00000100:00100000:1.0:1785787517.627717:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1785787517.627725:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051538850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+18:5818:x1872533769978368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785787517.628195:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051538850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+18:5818:x1872533769978368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 469us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787517.628204:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1785787517.628234:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769978368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785787517.628272:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769978496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785787517.628314:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787517.628323:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190507eac00 going to sleep for 11 seconds 00000100:00100000:1.0:1785787517.628340:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769978496 00000100:00100000:1.0:1785787517.628344:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769978496 00000100:00100000:1.0:1785787517.628361:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1785787517.628367:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051538450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+18:5818:x1872533769978496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785787517.628525:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051538450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+18:5818:x1872533769978496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787517.628532:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1785787517.628560:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769978496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1785787517.629166:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051538c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+17:5818:x1872533769977728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 36935us (36989us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787517.629186:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1785787517.634719:0:8346:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b374700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:8346:1872533769978624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785787517.634887:0:8346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787517.634937:0:8346:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905159de40 going to sleep for 11 seconds 00000100:00100000:0.0:1785787517.635117:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769978624 00000100:00100000:0.0:1785787517.635127:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769978624 00000100:00100000:0.0:1785787517.635172:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1785787517.635182:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+17:8346:x1872533769978624:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785787517.635481:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+17:8346:x1872533769978624:12345-0@lo:502:llog_process_th.0 Request processed in 299us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787517.635489:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1785787517.635818:0:8346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b374700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:8346:1872533769978624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785787517.635903:0:8346:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b374700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:8346:1872533769978752:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785787517.635934:0:8346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787517.635967:0:8346:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905159de40 going to sleep for 11 seconds 00000100:00100000:2.0:1785787517.636708:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769978752 00000100:00100000:2.0:1785787517.636714:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769978752 00000100:00100000:2.0:1785787517.636756:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1785787517.636766:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+17:8346:x1872533769978752:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785787517.637173:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+17:8346:x1872533769978752:12345-0@lo:502:llog_process_th.0 Request processed in 407us (1235us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787517.637180:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1785787517.637502:0:8346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b374700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:8346:1872533769978752:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1785787517.637535:0:8346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1785787517.648657:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1785787517.648703:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1785787517.648719:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff91905f902200/0xe2c2ff68a6e844a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e844af expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787517.648761:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff91905f902200/0xe2c2ff68a6e844a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e844af expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785787517.661433:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1785787517.661442:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1785787517.661448:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1785787517.661507:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff919050678e00/0xe2c2ff68a6e844b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787517.661520:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff919050678e00/0xe2c2ff68a6e844b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787517.661544:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff919050678e00/0xe2c2ff68a6e844b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787517.661599:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076ede300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769978880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1785787517.661690:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787517.661743:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff919077421240 going to sleep for 11 seconds 00000100:00100000:2.0:1785787517.663110:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769978880 00000100:00100000:2.0:1785787517.663126:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769978880 00000100:00100000:2.0:1785787517.663188:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1785787517.663198:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051539050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+17:5818:x1872533769978880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785787517.663219:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787517.663251:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190413a1400/0xe2c2ff68a6e844bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e844b6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787517.663283:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190413a1400/0xe2c2ff68a6e844bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e844b6 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787517.663295:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190413a1400/0xe2c2ff68a6e844bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e844b6 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787517.663305:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190413a1400, rc 0) 00000100:00100000:2.0:1785787517.663376:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051539050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+18:5818:x1872533769978880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (1686us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787517.663383:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1785787517.664407:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076ede300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769978880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1785787517.664434:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff919050678e00/0xe2c2ff68a6e844b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e844bd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787517.664445:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff919050678e00/0xe2c2ff68a6e844b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e844bd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787517.664551:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769979008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785787517.664613:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787517.664667:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190507eaa80 going to sleep for 11 seconds 00000100:00100000:0.0:1785787517.664927:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769979008 00000100:00100000:0.0:1785787517.664934:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769979008 00000100:00100000:0.0:1785787517.664988:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1785787517.664998:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051538050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+18:5818:x1872533769979008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785787517.665341:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051538050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+18:5818:x1872533769979008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 344us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787517.665350:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1785787517.666386:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769979008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785787517.666445:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769979136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785787517.666500:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787517.666540:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190507eaa80 going to sleep for 11 seconds 00000100:00100000:1.0:1785787517.666560:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769979136 00000100:00100000:1.0:1785787517.666566:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769979136 00000100:00100000:1.0:1785787517.666606:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1785787517.666614:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+18:5818:x1872533769979136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785787517.666802:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+18:5818:x1872533769979136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 188us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787517.666810:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1785787517.666868:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769979136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785787517.672471:0:8347:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076ede680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:8347:1872533769979264:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785787517.672593:0:8347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787517.672650:0:8347:0:(client.c:2702:ptlrpc_set_wait()) set ffff919077421480 going to sleep for 11 seconds 00000100:00100000:1.0:1785787517.672715:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769979264 00000100:00100000:1.0:1785787517.672725:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769979264 00000100:00100000:1.0:1785787517.672789:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1785787517.672800:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+18:8347:x1872533769979264:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785787517.673248:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+18:8347:x1872533769979264:12345-0@lo:502:llog_process_th.0 Request processed in 449us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787517.673257:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1785787517.673555:0:8347:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076ede680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:8347:1872533769979264:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1785787517.673597:0:8347:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785787517.673608:0:8347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785787517.673610:0:8347:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1785787517.673619:0:8347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1785787517.673652:0:8347:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076ede680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:8347:1872533769979392:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785787517.673685:0:8347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787517.673716:0:8347:0:(client.c:2702:ptlrpc_set_wait()) set ffff919077421480 going to sleep for 11 seconds 00000100:00100000:2.0:1785787517.673807:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769979392 00000100:00100000:2.0:1785787517.673818:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769979392 00000100:00100000:2.0:1785787517.673879:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1785787517.673886:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051539850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+18:8347:x1872533769979392:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785787517.674138:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051539850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+18:8347:x1872533769979392:12345-0@lo:502:llog_process_th.0 Request processed in 252us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787517.674145:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1785787517.675136:0:8347:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076ede680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:8347:1872533769979392:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1785787517.675167:0:8347:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785787517.675173:0:8347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785787517.675175:0:8347:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1785787517.675189:0:8347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1785787517.687430:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1785787517.687479:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1785787517.687494:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff919050678e00/0xe2c2ff68a6e844b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e844bd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787517.687509:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff919050678e00/0xe2c2ff68a6e844b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e844bd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785787517.694492:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1785787517.694502:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9190515cb380 from 1 10000000:01000000:2.0:1785787517.694508:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1785787517.695199:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff9190413a0e00/0xe2c2ff68a6e844c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787517.695212:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff9190413a0e00/0xe2c2ff68a6e844c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787517.695226:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff9190413a0e00/0xe2c2ff68a6e844c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787517.695267:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769979520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1785787517.695348:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787517.695409:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff919076bb0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1785787517.697139:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769979520 00000100:00100000:0.0:1785787517.697152:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769979520 00000100:00100000:0.0:1785787517.697218:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1785787517.697230:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+18:5818:x1872533769979520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785787517.697250:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787517.697268:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919050679800/0xe2c2ff68a6e844cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e844c4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787517.697298:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919050679800/0xe2c2ff68a6e844cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e844c4 expref: 19 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787517.697310:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919050679800/0xe2c2ff68a6e844cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e844c4 expref: 19 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787517.697320:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919050679800, rc 0) 00000100:00100000:0.0:1785787517.697387:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+19:5818:x1872533769979520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (2038us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787517.697394:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1785787517.698501:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769979520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1785787517.698532:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff9190413a0e00/0xe2c2ff68a6e844c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e844cb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787517.698544:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff9190413a0e00/0xe2c2ff68a6e844c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e844cb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787517.698627:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769979648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785787517.698680:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787517.698723:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190507ead80 going to sleep for 11 seconds 00000100:00100000:0.0:1785787517.698892:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769979648 00000100:00100000:0.0:1785787517.698898:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769979648 00000100:00100000:0.0:1785787517.698926:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1785787517.698933:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+19:5818:x1872533769979648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785787517.699209:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+19:5818:x1872533769979648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 275us (528us total) trans 0 rc -2/-2 00000100:00100000:0.0:1785787517.699217:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1785787517.699884:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769979648:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1785787517.699925:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1785787517.699933:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff9190413a0e00/0xe2c2ff68a6e844c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e844cb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787517.699943:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff9190413a0e00/0xe2c2ff68a6e844c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e844cb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787518.451061:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787519.230915:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787519.231530:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744784128 00000100:00100000:0.0:1785787519.231541:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744784128 00000100:00100000:0.0:1785787519.232249:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 167 00000100:00100000:0.0:1785787519.232280:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051504c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+8:5611:x1872533744784128:12345-192.168.203.53@tcp:101: 00010000:00010000:0.0:1785787519.232296:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787519.232313:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919050679e00/0xe2c2ff68a6e844d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd24b expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787519.232338:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919050679e00/0xe2c2ff68a6e844d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd24b expref: 9 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787519.232350:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919050679e00/0xe2c2ff68a6e844d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd24b expref: 9 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787519.232359:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919050679e00, rc 0) 00000100:00100000:0.0:1785787519.232411:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051504c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+9:5611:x1872533744784128:12345-192.168.203.53@tcp:101: Request processed in 142us (1505us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787519.232418:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 167 00000100:00100000:1.0:1785787519.239208:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787519.239375:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744784256 00000100:00100000:2.0:1785787519.239384:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744784256 00000100:00100000:2.0:1785787519.239441:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 168 00000100:00100000:2.0:1785787519.239451:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051507050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+9:5611:x1872533744784256:12345-192.168.203.53@tcp:501: 00000100:00100000:2.0:1785787519.240327:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051507050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+9:5611:x1872533744784256:12345-192.168.203.53@tcp:501: Request processed in 874us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787519.240335:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 168 00000100:00100000:3.0:1785787519.263990:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787519.264092:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744784384 00000100:00100000:1.0:1785787519.264102:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744784384 00000100:00100000:1.0:1785787519.264166:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 169 00000100:00100000:1.0:1785787519.264176:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051505c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+9:5611:x1872533744784384:12345-192.168.203.53@tcp:503: 00000100:00100000:1.0:1785787519.264394:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051505c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+9:5611:x1872533744784384:12345-192.168.203.53@tcp:503: Request processed in 219us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787519.264401:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 169 00000100:00100000:2.0:1785787519.274937:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787519.275319:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744784512 00000100:00100000:0.0:1785787519.275329:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744784512 00000100:00100000:0.0:1785787519.275387:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 170 00000100:00100000:0.0:1785787519.275396:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051505450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+9:6089:x1872533744784512:12345-192.168.203.53@tcp:502: 00000100:00100000:0.0:1785787519.275949:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051505450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+9:6089:x1872533744784512:12345-192.168.203.53@tcp:502: Request processed in 553us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787519.275957:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 170 00000100:00100000:2.0:1785787519.278103:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787519.278286:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744784640 00000100:00100000:1.0:1785787519.278293:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744784640 00000100:00100000:1.0:1785787519.278332:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 171 00000100:00100000:1.0:1785787519.278340:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051507450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+9:6089:x1872533744784640:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1785787519.278891:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051507450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+9:6089:x1872533744784640:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 550us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787519.278899:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 171 00000100:00100000:3.0:1785787519.282245:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787519.283267:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744784768 00000100:00100000:1.0:1785787519.283286:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744784768 00000100:00100000:1.0:1785787519.283338:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 172 00000100:00100000:1.0:1785787519.283348:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051504850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+9:5611:x1872533744784768:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1785787519.283386:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787519.283404:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919043c0f800/0xe2c2ff68a6e844d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd252 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787519.283992:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919043c0f800/0xe2c2ff68a6e844d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd252 expref: 10 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787519.284011:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919043c0f800/0xe2c2ff68a6e844d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd252 expref: 10 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787519.284020:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919043c0f800, rc 0) 00000100:00100000:1.0:1785787519.284281:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051504850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:5611:x1872533744784768:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 Request processed in 933us (2040us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787519.284289:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 172 00000100:00100000:3.0:1785787519.372815:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787519.372905:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744784896 00000100:00100000:0.0:1785787519.372914:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744784896 00000100:00100000:0.0:1785787519.372967:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 173 00000100:00100000:0.0:1785787519.372976:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051504450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:5611:x1872533744784896:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785787519.373244:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051504450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:5611:x1872533744784896:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 Request processed in 267us (436us total) trans 0 rc -2/-2 00000100:00100000:0.0:1785787519.373258:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 173 00000100:00100000:2.0:1785787519.413260:0:3334:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785787519.413288:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076ede680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533769979776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785787519.413350:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787519.414084:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769979776 00000100:00100000:0.0:1785787519.414093:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769979776 00000100:00100000:0.0:1785787519.414150:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1785787519.414159:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905267e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533769979776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785787519.414187:0:6620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785787519.414228:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905267e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533769979776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787519.414234:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1785787519.414398:0:3334:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076ede680 x1872533769979776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787535 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787519.414417:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076ede680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533769979776:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1785787519.414721:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1785787519.475022:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787520.125790:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787520.125858:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787520.125904:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787520.126007:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787520.126042:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744785408 00000100:00100000:3.0:1785787520.126050:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744785408 00000100:00100000:3.0:1785787520.126098:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744785280 00000100:00100000:3.0:1785787520.126101:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744785280 00000100:00100000:3.0:1785787520.126117:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 18 00000100:00100000:3.0:1785787520.126126:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b376d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:79280304-55c6-4698-bfc3-29d14648ba45+5:2389:x1872533744785408:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1785787520.126183:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b376d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:79280304-55c6-4698-bfc3-29d14648ba45+5:2389:x1872533744785408:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 58us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787520.126189:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 18 00000100:00100000:3.0:1785787520.126202:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 19 00000100:00100000:3.0:1785787520.126208:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b376300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:79280304-55c6-4698-bfc3-29d14648ba45+5:2389:x1872533744785280:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1785787520.126229:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b376300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:79280304-55c6-4698-bfc3-29d14648ba45+5:2389:x1872533744785280:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 22us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787520.126234:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 19 00000100:00080000:3.0:1785787520.126250:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785787520.126254:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785787520.126453:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744785152 00000100:00100000:1.0:1785787520.126457:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744785152 00000100:00100000:1.0:1785787520.126507:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 35 00000100:00100000:1.0:1785787520.126514:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+6:2389:x1872533744785152:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1785787520.126546:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+6:2389:x1872533744785152:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 33us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787520.126552:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 35 00000100:00080000:3.0:1785787520.127477:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785787520.128460:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744785024 00000100:00100000:2.0:1785787520.128467:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744785024 00000100:00100000:2.0:1785787520.128556:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 174 00000100:00100000:2.0:1785787520.128564:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051506050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:2389:x1872533744785024:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:2.0:1785787520.128613:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051506050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:2389:x1872533744785024:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 51us (2708us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787520.128629:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 174 00010000:00010000:3.0:1785787520.499034:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787521.523059:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785787521.973026:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533769979904:0@lo:400:kworker.0 00000100:00100000:1.0:1785787521.973091:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787521.973135:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3334:1872533769980416:0@lo:400:kworker.0 00000100:00100000:1.0:1785787521.973160:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787521.973211:0:3334:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785787521.973228:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533769980288:0@lo:400:kworker.0 00000100:00100000:1.0:1785787521.973267:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787521.973298:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3335:1872533769980032:0@lo:400:kworker.0 00000100:00100000:1.0:1785787521.973320:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787521.973335:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769980544:0@lo:400:kworker.0 00000100:00100000:1.0:1785787521.973367:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787521.973385:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785787521.973390:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533769980160:0@lo:400:kworker.0 00000100:00100000:1.0:1785787521.973411:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787521.973449:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769979904 00000100:00100000:1.0:1785787521.973456:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769979904 00000100:00100000:1.0:1785787521.973508:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1785787521.973516:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051506850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+19:3334:x1872533769979904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787521.973556:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051506850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+19:3334:x1872533769979904:12345-0@lo:400:kworker.0 Request processed in 41us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787521.973563:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1785787521.973591:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769980416 00000100:00100000:1.0:1785787521.973595:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769980416 00000100:00100000:1.0:1785787521.973629:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769980032 00000100:00100000:1.0:1785787521.973632:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769980032 00000100:00100000:1.0:1785787521.973641:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769980160 00000100:00100000:1.0:1785787521.973643:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769980160 00000100:00100000:1.0:1785787521.973656:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1785787521.973661:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3334:x1872533769980416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787521.973693:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3334:x1872533769980416:12345-0@lo:400:kworker.0 Request processed in 32us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787521.973700:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1785787521.973720:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1785787521.973726:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3335:x1872533769980032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787521.973759:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3335:x1872533769980032:12345-0@lo:400:kworker.0 Request processed in 33us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787521.973765:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1785787521.973777:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1785787521.973783:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533769980160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787521.973809:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533769980160:12345-0@lo:400:kworker.0 Request processed in 27us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787521.973814:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1785787521.973850:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769980288 00000100:00100000:1.0:1785787521.973854:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769980288 00000100:00100000:1.0:1785787521.973879:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769980544 00000100:00100000:1.0:1785787521.973882:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769980544 00000100:00100000:1.0:1785787521.973896:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1785787521.973901:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533769980288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787521.973929:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533769980288:12345-0@lo:400:kworker.0 Request processed in 27us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787521.973934:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1785787521.973945:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1785787521.973951:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769980544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787521.973976:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769980544:12345-0@lo:400:kworker.0 Request processed in 25us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787521.973982:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1785787521.974021:0:3334:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9190514f6680 x1872533769980288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787521.974046:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533769980288:0@lo:400:kworker.0 00000100:00100000:1.0:1785787521.974058:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533769979904:0@lo:400:kworker.0 00000100:00100000:1.0:1785787521.974067:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3334:1872533769980416:0@lo:400:kworker.0 00000100:00080000:1.0:1785787521.974096:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785787521.974099:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785787521.974102:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785787521.974113:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533769980160:0@lo:400:kworker.0 00000100:00100000:1.0:1785787521.974121:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3335:1872533769980032:0@lo:400:kworker.0 00010000:00080000:1.0:1785787521.974129:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9190514f4a80 x1872533769980544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787521.974137:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769980544:0@lo:400:kworker.0 00000020:00000080:1.0:1785787522.098781:0:8387:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffbc44c270 20000000:00000080:1.0:1785787522.098797:0:8387:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91907fce7800 uarg=0000000000000000 20000000:01000000:1.0:1785787522.101768:0:8387:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1785787522.101776:0:8387:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1785787522.101782:0:8387:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1785787522.105864:0:8388:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1785787522.106715:0:8387:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1785787522.134183:0:8387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1785787522.134239:0:8387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1785787522.134371:0:8387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1785787522.134396:0:8387:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1785787522.134414:0:8387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9190413a1000/0xe2c2ff68a6e844e0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787522.134430:0:8387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91908206b000/0xe2c2ff68a6e84255 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e8424e expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787522.134438:0:8387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9190413a1200/0xe2c2ff68a6e842b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e842b0 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787522.134455:0:8387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91905f902800/0xe2c2ff68a6e84382 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e8437b expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787522.134464:0:8387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91905f903c00/0xe2c2ff68a6e8443f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd21a expref: 9 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787522.134471:0:8387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9190413a1000/0xe2c2ff68a6e844e0 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787522.135226:0:8387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91905f903c00/0xe2c2ff68a6e8443f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd21a expref: 9 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787522.135244:0:8387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91905f903c00/0xe2c2ff68a6e8443f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd21a expref: 9 pid: 5813 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787522.135268:0:8387:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076ec9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8387:1872533769980672:192.168.203.53@tcp:104: 00010000:00010000:2.0:1785787522.135770:0:8387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91905f902800/0xe2c2ff68a6e84382 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2c2ff68a6e8437b expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787522.135779:0:8387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91905f902800/0xe2c2ff68a6e84382 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2c2ff68a6e8437b expref: 18 pid: 5813 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787522.135789:0:8387:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076ec9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8387:1872533769980800:0@lo:104: 00000100:00100000:2.0:1785787522.135843:0:8387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1785787522.135873:0:8387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9190413a1200/0xe2c2ff68a6e842b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2c2ff68a6e842b0 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787522.135882:0:8387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9190413a1200/0xe2c2ff68a6e842b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2c2ff68a6e842b0 expref: 18 pid: 5814 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787522.135904:0:8387:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076ec9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8387:1872533769980928:0@lo:104: 00000100:00100000:2.0:1785787522.135928:0:8387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1785787522.135947:0:8387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91908206b000/0xe2c2ff68a6e84255 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2c2ff68a6e8424e expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787522.135955:0:8387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91908206b000/0xe2c2ff68a6e84255 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2c2ff68a6e8424e expref: 18 pid: 5813 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787522.135963:0:8387:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076ecb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8387:1872533769981056:0@lo:104: 00000100:00100000:2.0:1785787522.135978:0:8387:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190771060c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785787522.136581:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1785787522.136601:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787522.136622:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769980800 00000100:00100000:3.0:1785787522.136628:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769980800 00000100:00100000:3.0:1785787522.136665:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769980928 00000100:00100000:3.0:1785787522.136668:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769980928 00000100:00100000:3.0:1785787522.136679:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769981056 00000100:00100000:3.0:1785787522.136681:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769981056 00000100:00100000:3.0:1785787522.136693:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1785787522.136700:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ecb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8642023-9103-4dbf-85d1-f204189bc871+5:8387:x1872533769980800:12345-0@lo:104: 00010000:00010000:3.0:1785787522.136719:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e8437b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e84382 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787522.136776:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1785787522.136782:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ecb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8642023-9103-4dbf-85d1-f204189bc871+5:8387:x1872533769980800:12345-0@lo:104: Request processed in 82us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787522.136789:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1785787522.136805:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1785787522.136811:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905f935050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8642023-9103-4dbf-85d1-f204189bc871+4:8387:x1872533769980928:12345-0@lo:104: 00010000:00010000:3.0:1785787522.136819:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff91908206b600/0xe2c2ff68a6e842b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e842b7 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787522.136884:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1785787522.136890:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905f935050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8642023-9103-4dbf-85d1-f204189bc871+4:8387:x1872533769980928:12345-0@lo:104: Request processed in 79us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787522.136895:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1785787522.136921:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1785787522.136927:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b374380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8642023-9103-4dbf-85d1-f204189bc871+3:8387:x1872533769981056:12345-0@lo:104: 00010000:00010000:3.0:1785787522.136934:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff9190413a1c00/0xe2c2ff68a6e8424e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e84255 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787522.136956:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1785787522.136960:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b374380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8642023-9103-4dbf-85d1-f204189bc871+3:8387:x1872533769981056:12345-0@lo:104: Request processed in 34us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787522.136966:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1785787522.136983:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1785787522.136988:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e8437b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e84382 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787522.137000:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903800 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:3.0:1785787522.137004:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e8437b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2c2ff68a6e84382 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787522.137012:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e8437b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2c2ff68a6e84382 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785787522.137019:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e8437b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2c2ff68a6e84382 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785787522.137025:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1785787522.137050:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e8437b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e84382 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787522.137057:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785787522.137075:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e8437b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e84382 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787522.137082:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e8437b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e84382 expref: -99 pid: 7505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787522.137093:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1785787522.137096:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff91908206b600/0xe2c2ff68a6e842b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e842b7 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787522.137102:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91908206b600 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:3.0:1785787522.137105:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff91908206b600/0xe2c2ff68a6e842b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2c2ff68a6e842b7 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787522.137122:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff91908206b600/0xe2c2ff68a6e842b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2c2ff68a6e842b7 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785787522.137129:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff91908206b600/0xe2c2ff68a6e842b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2c2ff68a6e842b7 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785787522.137134:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1785787522.137147:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff91908206b600/0xe2c2ff68a6e842b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e842b7 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787522.137153:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785787522.137351:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff91908206b600/0xe2c2ff68a6e842b0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e842b7 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787522.137359:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff91908206b600/0xe2c2ff68a6e842b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e842b7 expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787522.137371:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785787522.137375:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff9190413a1c00/0xe2c2ff68a6e8424e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e84255 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787522.137381:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413a1c00 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:3.0:1785787522.137384:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff9190413a1c00/0xe2c2ff68a6e8424e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2c2ff68a6e84255 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787522.137390:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff9190413a1c00/0xe2c2ff68a6e8424e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2c2ff68a6e84255 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785787522.137396:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff9190413a1c00/0xe2c2ff68a6e8424e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2c2ff68a6e84255 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785787522.137417:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1785787522.137433:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff9190413a1c00/0xe2c2ff68a6e8424e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e84255 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787522.137440:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785787522.137447:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff9190413a1c00/0xe2c2ff68a6e8424e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e84255 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787522.137454:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff9190413a1c00/0xe2c2ff68a6e8424e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e84255 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787522.137477:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787522.137478:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787522.137480:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787522.137487:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785787522.137776:0:8387:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076ec9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8387:1872533769980800:0@lo:104: 00000100:00100000:2.0:1785787522.137786:0:8387:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076ec9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8387:1872533769980928:0@lo:104: 00000100:00100000:2.0:1785787522.137793:0:8387:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076ecb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8387:1872533769981056:0@lo:104: 00000100:00100000:3.0:1785787522.147961:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785787522.147987:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8642023-9103-4dbf-85d1-f204189bc871:3335:1872533769981184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785787522.148055:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787522.148117:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533769981312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785787522.148139:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787522.148171:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785787522.148177:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533769981440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785787522.148195:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787522.148231:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769981184 00000100:00100000:3.0:1785787522.148238:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769981184 00010000:00010000:3.0:1785787522.148282:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91905f902800/0xe2c2ff68a6e84382 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e8437b expref: 19 pid: 5813 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787522.148319:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769981312 00000100:00100000:3.0:1785787522.148322:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769981312 00010000:00010000:3.0:1785787522.148334:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9190413a1200/0xe2c2ff68a6e842b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e842b0 expref: 20 pid: 5814 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787522.148616:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769981440 00000100:00100000:3.0:1785787522.148620:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769981440 00010000:00010000:3.0:1785787522.148637:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91908206b000/0xe2c2ff68a6e84255 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e8424e expref: 21 pid: 5813 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787522.148655:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1785787522.148663:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077089f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8642023-9103-4dbf-85d1-f204189bc871+21:3335:x1872533769981184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785787522.148676:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787522.148682:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91905f902800/0xe2c2ff68a6e84382 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e8437b expref: 21 pid: 5813 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787522.148692:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91905f902800/0xe2c2ff68a6e84382 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2c2ff68a6e8437b expref: 21 pid: 5813 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787522.148709:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91905f902800/0xe2c2ff68a6e84382 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2c2ff68a6e8437b expref: 21 pid: 5813 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787522.148723:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787522.148757:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077089f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8642023-9103-4dbf-85d1-f204189bc871+20:3335:x1872533769981184:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787522.148764:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1785787522.148782:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1785787522.148788:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077088a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8642023-9103-4dbf-85d1-f204189bc871+19:3333:x1872533769981312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785787522.148804:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787522.148809:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9190413a1200/0xe2c2ff68a6e842b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e842b0 expref: 19 pid: 5814 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787522.148818:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9190413a1200/0xe2c2ff68a6e842b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2c2ff68a6e842b0 expref: 19 pid: 5814 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787522.148847:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9190413a1200/0xe2c2ff68a6e842b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2c2ff68a6e842b0 expref: 19 pid: 5814 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787522.148857:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787522.148883:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077088a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8642023-9103-4dbf-85d1-f204189bc871+18:3333:x1872533769981312:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787522.148889:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1785787522.148901:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1785787522.148906:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907708a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8642023-9103-4dbf-85d1-f204189bc871+17:3333:x1872533769981440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785787522.148913:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787522.148917:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91908206b000/0xe2c2ff68a6e84255 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e8424e expref: 17 pid: 5813 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787522.148925:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91908206b000/0xe2c2ff68a6e84255 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2c2ff68a6e8424e expref: 17 pid: 5813 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787522.148934:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91908206b000/0xe2c2ff68a6e84255 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2c2ff68a6e8424e expref: 17 pid: 5813 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787522.148942:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787522.148959:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907708a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8642023-9103-4dbf-85d1-f204189bc871+16:3333:x1872533769981440:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787522.148973:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1785787522.149004:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533769981440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785787522.149011:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533769981312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785787522.149039:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8642023-9103-4dbf-85d1-f204189bc871:3335:1872533769981184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785787522.163676:0:8387:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076ec9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8387:1872533769980672:192.168.203.53@tcp:104: 00010000:00010000:0.0:1785787522.163717:0:8387:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9190413a1000/0xe2c2ff68a6e844e0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787522.168681:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787522.172160:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744785536 00000100:00100000:3.0:1785787522.172174:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744785536 00010000:00010000:3.0:1785787522.172231:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91905f903c00/0xe2c2ff68a6e8443f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd21a expref: 10 pid: 5813 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787522.172277:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 24 00000100:00100000:3.0:1785787522.172286:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076edce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:2390:x1872533744785536:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785787522.172300:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787522.172307:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91905f903c00/0xe2c2ff68a6e8443f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd21a expref: 10 pid: 5813 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787522.172319:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91905f903c00/0xe2c2ff68a6e8443f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd21a expref: 10 pid: 5813 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787522.172336:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91905f903c00/0xe2c2ff68a6e8443f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd21a expref: 10 pid: 5813 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787522.172364:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9190413a1000/0xe2c2ff68a6e844e0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787522.172372:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190413a1000/0xe2c2ff68a6e844e0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787522.172406:0:5805:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9190413a1000/0xe2c2ff68a6e844e0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787522.172568:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9190413a1000/0xe2c2ff68a6e844e0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787522.172576:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9190413a1000/0xe2c2ff68a6e844e0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787522.172583:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9190413a1000/0xe2c2ff68a6e844e0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787522.172589:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413a1000 already unused, calling callback (ffffffffc174c300) 00010000:00010000:3.0:1785787522.172593:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9190413a1000/0xe2c2ff68a6e844e0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787522.172601:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9190413a1000/0xe2c2ff68a6e844e0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787522.198588:0:8387:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9190413a1000/0xe2c2ff68a6e844e0 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787522.198614:0:8387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9190413a1000/0xe2c2ff68a6e844e0 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787522.211937:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9190413a1000/0xe2c2ff68a6e844e0 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787522.211956:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9190413a1000/0xe2c2ff68a6e844e0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787522.211978:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785787522.225240:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076edce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+9:2390:x1872533744785536:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 52943us (56554us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787522.225279:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 24 00000100:00100000:1.0:1785787522.483368:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076edea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769981568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785787522.483431:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787522.483536:0:6621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769981568 00000100:00100000:0.0:1785787522.483544:0:6621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769981568 00000100:00100000:0.0:1785787522.483615:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1785787522.483625:0:6621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769981568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785787522.483656:0:6621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785787522.483701:0:6621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769981568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787522.483708:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1785787522.483746:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076edea00 x1872533769981568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787538 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787522.483763:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076edea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769981568:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785787522.554657:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787523.571048:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787523.581781:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787523.581982:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744785664 00000100:00100000:2.0:1785787523.581992:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744785664 00000100:00100000:2.0:1785787523.582043:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 176 00000100:00100000:2.0:1785787523.582053:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051507850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+9:5611:x1872533744785664:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785787523.582069:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787523.582087:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190413a1200/0xe2c2ff68a6e844e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd259 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787523.582112:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190413a1200/0xe2c2ff68a6e844e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd259 expref: 10 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787523.582122:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190413a1200/0xe2c2ff68a6e844e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd259 expref: 10 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787523.582142:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190413a1200, rc 0) 00000100:00100000:2.0:1785787523.582194:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051507850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:5611:x1872533744785664:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 Request processed in 142us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787523.582201:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 176 00000100:00100000:3.0:1785787523.586068:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787523.586128:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744785792 00000100:00100000:0.0:1785787523.586138:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744785792 00000100:00100000:0.0:1785787523.586184:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 177 00000100:00100000:0.0:1785787523.586193:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051505050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:5611:x1872533744785792:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785787523.590118:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051505050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:5611:x1872533744785792:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 Request processed in 3916us (4046us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787523.590130:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 177 00000100:00100000:0.0:1785787523.597479:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787523.597672:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744785920 00000100:00100000:3.0:1785787523.597688:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744785920 00000100:00100000:3.0:1785787523.597743:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 178 00000100:00100000:3.0:1785787523.597754:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051504050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:5611:x1872533744785920:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785787523.598797:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051504050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:5611:x1872533744785920:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 Request processed in 1041us (1323us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787523.598806:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 178 00000100:00100000:2.0:1785787523.612930:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787523.613035:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744786048 00000100:00100000:0.0:1785787523.613045:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744786048 00000100:00100000:0.0:1785787523.613095:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 179 00000100:00100000:0.0:1785787523.613104:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051507c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:6146:x1872533744786048:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1785787523.613683:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051507c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:6146:x1872533744786048:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 579us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787523.613691:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 179 00000100:00100000:3.0:1785787523.622753:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787523.623037:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744786176 00000100:00100000:1.0:1785787523.623047:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744786176 00000100:00100000:1.0:1785787523.624169:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 180 00000100:00100000:1.0:1785787523.624184:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051506c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:6146:x1872533744786176:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1785787523.624438:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051506c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:6146:x1872533744786176:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 258us (1693us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787523.624446:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 180 10000000:01000000:3.0:1785787523.707962:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1785787523.707969:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff91907fddf800 from 4 10000000:01000000:3.0:1785787523.707974:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1785787523.708020:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff91905f902800/0xe2c2ff68a6e844ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787523.708032:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff91905f902800/0xe2c2ff68a6e844ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787523.708044:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff91905f902800/0xe2c2ff68a6e844ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787523.708067:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077089500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769981696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1785787523.708127:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787523.709758:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190482906c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785787523.709783:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769981696 00000100:00100000:3.0:1785787523.709791:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769981696 00000100:00100000:3.0:1785787523.710646:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1785787523.710659:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051505850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+16:5818:x1872533769981696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785787523.710674:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787523.710691:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91905f903c00/0xe2c2ff68a6e844f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e844ee expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787523.710735:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91905f903c00/0xe2c2ff68a6e844f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e844ee expref: 17 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787523.710745:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91905f903c00/0xe2c2ff68a6e844f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e844ee expref: 17 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787523.710755:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f903c00, rc 0) 00000100:00100000:3.0:1785787523.710809:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051505850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+17:5818:x1872533769981696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (2680us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787523.710816:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1785787523.712284:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077089500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769981696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785787523.712304:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff91905f902800/0xe2c2ff68a6e844ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e844f5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787523.712313:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff91905f902800/0xe2c2ff68a6e844ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e844f5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787523.712376:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077089500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769981824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785787523.713028:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787523.714722:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190482906c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785787523.718321:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769981824 00000100:00100000:0.0:1785787523.718335:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769981824 00000100:00100000:0.0:1785787523.719958:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1785787523.719972:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051506450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+17:5818:x1872533769981824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785787523.720251:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051506450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+17:5818:x1872533769981824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 283us (7223us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787523.720259:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1785787523.720342:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077089500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769981824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785787523.720386:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077089500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769981952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785787523.720426:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787523.728871:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190482906c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785787523.729231:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769981952 00000100:00100000:1.0:1785787523.729241:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769981952 00000100:00100000:0.0:1785787523.730249:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1785787523.730262:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+17:5818:x1872533769981952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785787523.730495:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+17:5818:x1872533769981952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 230us (10062us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787523.730502:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1785787523.731531:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077089500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769981952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785787523.733756:0:8418:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077089500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:8418:1872533769982080:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785787523.733821:0:8418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787523.734264:0:8418:0:(client.c:2702:ptlrpc_set_wait()) set ffff919048290f00 going to sleep for 11 seconds 00000100:00100000:2.0:1785787523.734324:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769982080 00000100:00100000:2.0:1785787523.734331:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769982080 00000100:00100000:2.0:1785787523.734363:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1785787523.734371:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+17:8418:x1872533769982080:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785787523.734733:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+17:8418:x1872533769982080:12345-0@lo:502:llog_process_th.0 Request processed in 362us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787523.734742:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1785787523.734978:0:8418:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077089500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:8418:1872533769982080:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1785787523.735004:0:8418:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1785787523.735014:0:8418:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785787523.735017:0:8418:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1785787523.735023:0:8418:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff91907fddf800 00000020:00000080:3.0:1785787523.735026:0:8418:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1785787523.735096:0:8418:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077089500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:8418:1872533769982208:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785787523.735128:0:8418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787523.736237:0:8418:0:(client.c:2702:ptlrpc_set_wait()) set ffff919048290f00 going to sleep for 11 seconds 00000100:00100000:1.0:1785787523.736662:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769982208 00000100:00100000:1.0:1785787523.736669:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769982208 00000100:00100000:1.0:1785787523.736695:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1785787523.736703:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+17:8418:x1872533769982208:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785787523.737686:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+17:8418:x1872533769982208:12345-0@lo:502:llog_process_th.0 Request processed in 982us (2555us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787523.737695:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1785787523.737791:0:8418:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077089500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:8418:1872533769982208:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1785787523.737815:0:8418:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785787523.737822:0:8418:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785787523.737824:0:8418:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1785787523.737906:0:8418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1785787523.738652:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1785787523.738672:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1785787523.738681:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff91905f902800/0xe2c2ff68a6e844ee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e844f5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787523.738693:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff91905f902800/0xe2c2ff68a6e844ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e844f5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785787523.738714:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1785787523.738717:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff919048214000 from 4 10000000:01000000:1.0:1785787523.738720:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1785787523.738748:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff919043c0fa00/0xe2c2ff68a6e844fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787523.738755:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff919043c0fa00/0xe2c2ff68a6e844fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787523.738764:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff919043c0fa00/0xe2c2ff68a6e844fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787523.738782:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fe17480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769982336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1785787523.738815:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787523.743344:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff919076bb0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1785787523.745346:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769982336 00000100:00100000:3.0:1785787523.745357:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769982336 00000100:00100000:3.0:1785787523.745438:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1785787523.745448:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+17:5818:x1872533769982336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785787523.745471:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787523.745496:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91905f903a00/0xe2c2ff68a6e84503 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e844fc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787523.745523:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91905f903a00/0xe2c2ff68a6e84503 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e844fc expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787523.745551:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91905f903a00/0xe2c2ff68a6e84503 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e844fc expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787523.745560:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f903a00, rc 0) 00000100:00100000:3.0:1785787523.746810:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+18:5818:x1872533769982336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1361us (7990us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787523.746819:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1785787523.746890:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fe17480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769982336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785787523.746908:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff919043c0fa00/0xe2c2ff68a6e844fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84503 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787523.746917:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff919043c0fa00/0xe2c2ff68a6e844fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e84503 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787523.746981:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077089500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769982464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785787523.747012:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787523.747029:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff919048290540 going to sleep for 11 seconds 00000100:00100000:3.0:1785787523.747044:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769982464 00000100:00100000:3.0:1785787523.747048:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769982464 00000100:00100000:3.0:1785787523.747069:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1785787523.747074:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+18:5818:x1872533769982464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785787523.747303:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+18:5818:x1872533769982464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 227us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787523.747310:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1785787523.747338:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077089500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769982464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785787523.747372:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077089500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769982592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785787523.747419:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787523.747431:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff919048290540 going to sleep for 11 seconds 00000100:00100000:3.0:1785787523.747442:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769982592 00000100:00100000:3.0:1785787523.747445:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769982592 00000100:00100000:3.0:1785787523.747471:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1785787523.747478:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+18:5818:x1872533769982592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785787523.747769:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+18:5818:x1872533769982592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 291us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787523.747775:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1785787523.747809:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077089500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769982592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785787523.749321:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fe17800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:8420:1872533769982720:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785787523.749368:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787523.749402:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190526309c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785787523.749700:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769982720 00000100:00100000:2.0:1785787523.749705:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769982720 00000100:00100000:2.0:1785787523.749742:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1785787523.749750:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+18:8420:x1872533769982720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785787523.749926:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+18:8420:x1872533769982720:12345-0@lo:502:llog_process_th.0 Request processed in 176us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787523.749933:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1785787523.750277:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fe17800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:8420:1872533769982720:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1785787523.750301:0:8420:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1785787523.750309:0:8420:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785787523.750312:0:8420:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1785787523.750319:0:8420:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff919048214000 00000020:00000080:1.0:1785787523.750322:0:8420:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1785787523.750391:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fe17800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:8420:1872533769982848:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785787523.750438:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787523.750462:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190526309c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785787523.750720:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769982848 00000100:00100000:3.0:1785787523.750724:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769982848 00000100:00100000:3.0:1785787523.750755:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1785787523.750762:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+18:8420:x1872533769982848:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785787523.750889:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+18:8420:x1872533769982848:12345-0@lo:502:llog_process_th.0 Request processed in 127us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787523.750896:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1785787523.750971:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fe17800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:8420:1872533769982848:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1785787523.750988:0:8420:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1785787523.750993:0:8420:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785787523.750994:0:8420:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1785787523.750998:0:8420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1785787523.751121:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1785787523.751138:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1785787523.751205:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff919043c0fa00/0xe2c2ff68a6e844fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84503 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787523.751217:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff919043c0fa00/0xe2c2ff68a6e844fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84503 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785787523.751237:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1785787523.751240:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff919056a98000 from 4 10000000:01000000:3.0:1785787523.751242:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1785787523.751264:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e8450a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787523.751271:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e8450a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787523.751279:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e8450a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787523.751293:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077089500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769982976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1785787523.751317:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787523.751338:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff919056815480 going to sleep for 11 seconds 00000100:00100000:1.0:1785787523.751382:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769982976 00000100:00100000:1.0:1785787523.751386:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769982976 00000100:00100000:1.0:1785787523.751428:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1785787523.751434:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+18:5818:x1872533769982976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1785787523.751442:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787523.751452:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919043c0e800/0xe2c2ff68a6e84511 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e8450a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787523.751479:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919043c0e800/0xe2c2ff68a6e84511 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e8450a expref: 19 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787523.751883:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919043c0e800/0xe2c2ff68a6e84511 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e8450a expref: 19 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787523.751892:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919043c0e800, rc 0) 00000100:00100000:1.0:1785787523.751921:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+19:5818:x1872533769982976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 488us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787523.751927:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1785787523.752252:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077089500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769982976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785787523.752265:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e8450a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84511 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787523.752273:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e8450a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e84511 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787523.752316:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077089500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769983104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785787523.752342:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787523.752371:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff919056815480 going to sleep for 11 seconds 00000100:00100000:3.0:1785787523.753670:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769983104 00000100:00100000:3.0:1785787523.753677:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769983104 00000100:00100000:3.0:1785787523.753720:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1785787523.753728:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051581050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+19:5818:x1872533769983104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785787523.753955:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051581050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+19:5818:x1872533769983104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 227us (1611us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787523.753962:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1785787523.753997:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077089500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769983104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785787523.754029:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077089500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769983232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785787523.754063:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787523.754084:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff919050e633c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785787523.754094:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769983232 00000100:00100000:3.0:1785787523.754097:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769983232 00000100:00100000:3.0:1785787523.754115:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1785787523.754120:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051580050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+19:5818:x1872533769983232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785787523.755429:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051580050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+19:5818:x1872533769983232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1305us (1362us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787523.755437:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1785787523.755479:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077089500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533769983232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785787523.760499:0:8421:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076edea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:8421:1872533769983360:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785787523.760571:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787523.762251:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769983360 00000100:00100000:1.0:1785787523.762261:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769983360 00000100:00100000:1.0:1785787523.762311:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1785787523.762320:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051583c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+19:8421:x1872533769983360:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785787523.762718:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051583c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+19:8421:x1872533769983360:12345-0@lo:502:llog_process_th.0 Request processed in 399us (2146us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787523.762730:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1785787523.768747:0:8421:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190770ab180 going to sleep for 11 seconds 00000100:00100000:0.0:1785787523.768786:0:8421:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076edea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:8421:1872533769983360:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1785787523.768823:0:8421:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785787523.768846:0:8421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785787523.768848:0:8421:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1785787523.768855:0:8421:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff919056a98000 00000020:00000080:0.0:1785787523.768858:0:8421:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1785787523.768942:0:8421:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076edea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:8421:1872533769983488:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785787523.769006:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787523.769035:0:8421:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190770ab180 going to sleep for 11 seconds 00000100:00100000:3.0:1785787523.769742:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769983488 00000100:00100000:3.0:1785787523.769749:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769983488 00000100:00100000:3.0:1785787523.769796:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1785787523.769805:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051582c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+19:8421:x1872533769983488:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785787523.770024:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051582c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+19:8421:x1872533769983488:12345-0@lo:502:llog_process_th.0 Request processed in 219us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787523.770032:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1785787523.771479:0:8421:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076edea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:8421:1872533769983488:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1785787523.771690:0:8421:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785787523.771698:0:8421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785787523.771699:0:8421:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1785787523.771704:0:8421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1785787523.772229:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1785787523.772249:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1785787523.772259:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e8450a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84511 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787523.772270:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e8450a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84511 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787524.531048:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785787524.531070:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076edea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769983616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785787524.531135:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787524.531229:0:8140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769983616 00000100:00100000:0.0:1785787524.531237:0:8140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769983616 00000100:00100000:0.0:1785787524.531297:0:8140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1785787524.531307:0:8140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769983616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785787524.531347:0:8140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785787524.531397:0:8140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769983616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787524.531416:0:8140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1785787524.531466:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076edea00 x1872533769983616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787540 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787524.531484:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076edea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769983616:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1785787524.532027:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1785787524.597287:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787525.245955:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787525.246037:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787525.246067:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787525.246086:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787525.246112:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744786688 00000100:00100000:3.0:1785787525.246121:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744786688 00000100:00100000:3.0:1785787525.246197:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744786560 00000100:00100000:3.0:1785787525.246200:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744786560 00000100:00100000:3.0:1785787525.246217:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 22 00000100:00100000:3.0:1785787525.246226:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907708b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+5:2389:x1872533744786688:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1785787525.246287:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907708b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+5:2389:x1872533744786688:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 62us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787525.246294:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 22 00000100:00100000:3.0:1785787525.246308:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 23 00000100:00100000:3.0:1785787525.246314:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077088e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+5:2389:x1872533744786560:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1785787525.246346:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077088e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+5:2389:x1872533744786560:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 31us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787525.246352:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 23 00000100:00080000:3.0:1785787525.246368:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785787525.246372:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785787525.248441:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744786304 00000100:00100000:2.0:1785787525.248450:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744786304 00000100:00100000:2.0:1785787525.248501:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 196 00000100:00100000:2.0:1785787525.248511:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051581850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:2389:x1872533744786304:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:2.0:1785787525.248561:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051581850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:2389:x1872533744786304:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 52us (2493us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787525.248568:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 196 00000100:00100000:1.0:1785787525.263896:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744786432 00000100:00100000:1.0:1785787525.263915:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744786432 00000100:00100000:3.0:1785787525.274726:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 39 00000100:00100000:3.0:1785787525.274739:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077089500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+6:2389:x1872533744786432:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1785787525.274812:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077089500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+6:2389:x1872533744786432:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 77us (28865us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787525.274820:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 39 00000100:00080000:1.0:1785787525.275812:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1785787525.626511:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787526.648004:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785787527.091671:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fe15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533769983872:0@lo:400:kworker.0 00000100:00100000:1.0:1785787527.091736:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787527.091784:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533769984384:0@lo:400:kworker.0 00000100:00100000:1.0:1785787527.091808:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787527.091860:0:3334:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1785787527.091866:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fe14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533769983744:0@lo:400:kworker.0 00000100:00100000:1.0:1785787527.091892:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787527.091913:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3334:1872533769984256:0@lo:400:kworker.0 00000100:00100000:1.0:1785787527.091930:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787527.091953:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fe17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533769984000:0@lo:400:kworker.0 00000100:00100000:1.0:1785787527.091972:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787527.091987:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785787527.091992:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769984128:0@lo:400:kworker.0 00000100:00100000:1.0:1785787527.092009:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787527.092036:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769983872 00000100:00100000:1.0:1785787527.092043:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769983872 00000100:00100000:1.0:1785787527.092076:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769984256 00000100:00100000:1.0:1785787527.092079:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769984256 00000100:00100000:1.0:1785787527.092111:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769984000 00000100:00100000:1.0:1785787527.092114:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769984000 00000100:00100000:1.0:1785787527.092128:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1785787527.092136:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533769983872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787527.092186:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533769983872:12345-0@lo:400:kworker.0 Request processed in 50us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787527.092192:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1785787527.092209:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1785787527.092215:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3334:x1872533769984256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787527.092242:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3334:x1872533769984256:12345-0@lo:400:kworker.0 Request processed in 27us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787527.092247:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1785787527.092259:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1785787527.092265:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533769984000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787527.092296:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533769984000:12345-0@lo:400:kworker.0 Request processed in 31us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787527.092302:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1785787527.092320:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769984384 00000100:00100000:1.0:1785787527.092323:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769984384 00000100:00100000:1.0:1785787527.092356:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769984128 00000100:00100000:1.0:1785787527.092359:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769984128 00000100:00100000:1.0:1785787527.092374:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1785787527.092394:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533769984384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787527.092423:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533769984384:12345-0@lo:400:kworker.0 Request processed in 44us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787527.092429:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1785787527.092450:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1785787527.092463:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769984128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787527.092492:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769984128:12345-0@lo:400:kworker.0 Request processed in 30us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787527.092498:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1785787527.092516:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769983744 00000100:00100000:1.0:1785787527.092519:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769983744 00000100:00100000:1.0:1785787527.092542:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1785787527.092548:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051582450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+19:3334:x1872533769983744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787527.092603:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051582450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+19:3334:x1872533769983744:12345-0@lo:400:kworker.0 Request processed in 54us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787527.092610:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:1.0:1785787527.092644:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785787527.092648:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785787527.092650:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1785787527.092677:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9190514f6300 x1872533769984128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787527.092690:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769984128:0@lo:400:kworker.0 00000100:00100000:1.0:1785787527.092700:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fe17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533769984000:0@lo:400:kworker.0 00000100:00100000:1.0:1785787527.092727:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fe14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533769983744:0@lo:400:kworker.0 00000100:00100000:1.0:1785787527.092735:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3334:1872533769984256:0@lo:400:kworker.0 00000100:00100000:1.0:1785787527.092743:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fe15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533769983872:0@lo:400:kworker.0 00010000:00080000:1.0:1785787527.092752:0:3334:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9190514f5880 x1872533769984384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787527.092759:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533769984384:0@lo:400:kworker.0 00000100:00100000:0.0:1785787527.604478:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076edea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769984512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785787527.604549:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787527.604636:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769984512 00000100:00100000:0.0:1785787527.604644:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769984512 00000100:00100000:0.0:1785787527.604685:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1785787527.604692:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076edc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769984512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785787527.604725:0:6620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785787527.604766:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076edc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769984512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787527.604774:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1785787527.604812:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076edea00 x1872533769984512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787543 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787527.604850:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076edea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769984512:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1785787527.672698:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787528.692209:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785787529.661732:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076ecad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769984640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785787529.661795:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787529.668811:0:6621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769984640 00000100:00100000:2.0:1785787529.668825:0:6621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769984640 00000100:00100000:2.0:1785787529.668897:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1785787529.668906:0:6621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ec8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769984640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785787529.668940:0:6621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785787529.669011:0:6621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ec8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769984640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (7215us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787529.669018:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1785787529.669104:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076ecad80 x1872533769984640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787545 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787529.669122:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076ecad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769984640:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1785787529.669618:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1785787529.722807:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787530.369756:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787530.369806:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787530.369951:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744786816 00000100:00100000:1.0:1785787530.369960:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744786816 00000100:00100000:1.0:1785787530.370014:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 198 00000100:00100000:1.0:1785787530.370023:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051580c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:2391:x1872533744786816:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1785787530.370093:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051580c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:2391:x1872533744786816:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 70us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787530.370100:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 198 00000100:00100000:3.0:1785787530.370544:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744786944 00000100:00100000:3.0:1785787530.370558:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744786944 00000100:00100000:3.0:1785787530.370618:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 43 00000100:00100000:3.0:1785787530.370626:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076edea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+6:2391:x1872533744786944:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1785787530.370666:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076edea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+6:2391:x1872533744786944:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 41us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787530.370673:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 43 00000100:00080000:1.0:1785787530.370930:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785787530.378498:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787530.378543:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787530.378584:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744787072 00000100:00100000:0.0:1785787530.378605:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744787072 00000100:00100000:0.0:1785787530.378653:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744787200 00000100:00100000:0.0:1785787530.378656:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744787200 00000100:00100000:0.0:1785787530.378672:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 10 00000100:00100000:0.0:1785787530.378680:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076edd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:79280304-55c6-4698-bfc3-29d14648ba45+5:2387:x1872533744787072:12345-192.168.203.53@tcp:9:kworker.0 00000020:00000080:0.0:1785787530.378714:0:6617:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2c2ff68a6e8444d 00000100:00080000:0.0:1785787530.378722:0:6617:0:(import.c:65:import_set_state_nolock()) ffff91907fe09000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1785787530.378753:0:6617:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1785787530.379091:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076edd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:79280304-55c6-4698-bfc3-29d14648ba45+2:2387:x1872533744787072:12345-192.168.203.53@tcp:9:kworker.0 Request processed in 410us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787530.379099:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 10 00000100:00100000:0.0:1785787530.379114:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 11 00000100:00100000:0.0:1785787530.379121:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076edca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:79280304-55c6-4698-bfc3-29d14648ba45+5:2387:x1872533744787200:12345-192.168.203.53@tcp:9:kworker.0 00000020:00000080:0.0:1785787530.379133:0:6617:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2c2ff68a6e84454 00000100:00080000:0.0:1785787530.379139:0:6617:0:(import.c:65:import_set_state_nolock()) ffff91907fe0d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1785787530.379157:0:6617:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1785787530.379330:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076edca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:79280304-55c6-4698-bfc3-29d14648ba45+2:2387:x1872533744787200:12345-192.168.203.53@tcp:9:kworker.0 Request processed in 208us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787530.379336:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 11 00010000:00010000:0.0:1785787530.379509:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1785787530.379517:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785787530.379531:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1785787530.381540:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787530.739020:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1785787531.169692:0:8686:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg353-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1785787531.763791:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785787532.211211:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533769984896:0@lo:400:kworker.0 00000100:00100000:1.0:1785787532.211275:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787532.211342:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905faf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533769985408:0@lo:400:kworker.0 00000100:00100000:1.0:1785787532.211378:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787532.211408:0:3334:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1785787532.211415:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533769984768:0@lo:400:kworker.0 00000100:00100000:1.0:1785787532.211442:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787532.211463:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905faf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3334:1872533769985280:0@lo:400:kworker.0 00000100:00100000:1.0:1785787532.211484:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787532.211511:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769984768 00000100:00100000:1.0:1785787532.211518:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769984768 00000100:00100000:1.0:1785787532.211568:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1785787532.211577:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+19:3334:x1872533769984768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787532.211624:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+19:3334:x1872533769984768:12345-0@lo:400:kworker.0 Request processed in 48us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787532.211632:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1785787532.211688:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533769984768:0@lo:400:kworker.0 00000100:00100000:0.0:1785787532.211809:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769985408 00000100:00100000:0.0:1785787532.211814:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769985408 00000100:00100000:0.0:1785787532.211871:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1785787532.211878:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533769985408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787532.211918:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533769985408:12345-0@lo:400:kworker.0 Request processed in 41us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787532.211932:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1785787532.211960:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1785787532.212065:0:3334:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91905faf5c00 x1872533769985408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787532.212077:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905faf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533769985408:0@lo:400:kworker.0 00000100:00100000:3.0:1785787532.212362:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769984896 00000100:00100000:3.0:1785787532.212366:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769984896 00000100:00100000:3.0:1785787532.212399:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769985280 00000100:00100000:3.0:1785787532.212403:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769985280 00000100:00100000:3.0:1785787532.212431:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1785787532.212439:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533769984896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787532.212476:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533769984896:12345-0@lo:400:kworker.0 Request processed in 38us (1200us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787532.212483:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1785787532.212495:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1785787532.212501:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3334:x1872533769985280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787532.212526:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3334:x1872533769985280:12345-0@lo:400:kworker.0 Request processed in 26us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787532.212531:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1785787532.212601:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785787532.212621:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905faf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3334:1872533769985280:0@lo:400:kworker.0 00000100:00100000:1.0:1785787532.212631:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533769984896:0@lo:400:kworker.0 00000100:00100000:2.0:1785787532.212855:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533769985024:0@lo:400:kworker.0 00000100:00100000:2.0:1785787532.212885:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787532.212916:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785787532.212922:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905faf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769985152:0@lo:400:kworker.0 00000100:00100000:2.0:1785787532.212943:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787532.213022:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769985152 00000100:00100000:0.0:1785787532.213035:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769985152 00000100:00100000:0.0:1785787532.213076:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1785787532.213084:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769985152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787532.213119:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769985152:12345-0@lo:400:kworker.0 Request processed in 35us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787532.213125:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1785787532.213177:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1785787532.213236:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91905faf5180 x1872533769985152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787532.213246:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905faf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769985152:0@lo:400:kworker.0 00000100:00100000:3.0:1785787532.213333:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769985024 00000100:00100000:3.0:1785787532.213337:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769985024 00000100:00100000:3.0:1785787532.213377:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1785787532.213392:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ecad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533769985024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787532.213433:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ecad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533769985024:12345-0@lo:400:kworker.0 Request processed in 43us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787532.213439:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1785787532.213489:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785787532.213549:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533769985024:0@lo:400:kworker.0 00000100:00100000:2.0:1785787532.723095:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076eded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769985536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785787532.723160:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787532.723288:0:8140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769985536 00000100:00100000:0.0:1785787532.723297:0:8140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769985536 00000100:00100000:0.0:1785787532.723341:0:8140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1785787532.723349:0:8140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769985536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785787532.723379:0:8140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785787532.723424:0:8140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769985536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787532.723431:0:8140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1785787532.723629:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076eded80 x1872533769985536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787548 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787532.723648:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076eded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769985536:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1785787532.795291:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787533.812479:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1785787533.867552:0:6642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 79280304-55c6-4698-bfc3-29d14648ba45 00000020:00000080:2.0:1785787533.867560:0:6642:0:(genops.c:906:class_export_put()) final put ffff91907fe0a000/79280304-55c6-4698-bfc3-29d14648ba45 00000020:00000080:2.0:1785787533.867582:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff91907fe0a000/79280304-55c6-4698-bfc3-29d14648ba45 for lustre-OST0000 00000020:00000080:2.0:1785787533.867616:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91907fe09000 for lustre-OST0000 00000100:00100000:1.0:1785787534.773465:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785787534.773487:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076edc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769985664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785787534.773565:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787534.773867:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769985664 00000100:00100000:2.0:1785787534.773876:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769985664 00000100:00100000:2.0:1785787534.773933:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1785787534.773941:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769985664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785787534.773971:0:6620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785787534.774018:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769985664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787534.774025:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1785787534.774061:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076edc700 x1872533769985664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787550 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787534.774078:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076edc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769985664:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1785787534.778796:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1785787534.832676:0:7522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 79280304-55c6-4698-bfc3-29d14648ba45 00000020:00000080:3.0:1785787534.832685:0:7522:0:(genops.c:906:class_export_put()) final put ffff91907fe0f800/79280304-55c6-4698-bfc3-29d14648ba45 00000020:00000080:1.0:1785787534.832797:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff91907fe0f800/79280304-55c6-4698-bfc3-29d14648ba45 for lustre-OST0001 00010000:00010000:0.0:1785787534.836678:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1785787534.839176:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91907fe0d800 for lustre-OST0001 00000100:00100000:3.0:1785787535.485693:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787535.485734:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787535.485762:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744787456 00000100:00100000:3.0:1785787535.485770:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744787456 00000100:00100000:3.0:1785787535.485823:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 47 00000100:00100000:3.0:1785787535.485852:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+6:2388:x1872533744787456:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1785787535.485915:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+6:2388:x1872533744787456:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 64us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787535.485922:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 47 00000100:00080000:3.0:1785787535.485942:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785787535.486803:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744787328 00000100:00100000:0.0:1785787535.486809:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744787328 00000100:00100000:0.0:1785787535.486859:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 200 00000100:00100000:0.0:1785787535.486867:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:2388:x1872533744787328:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1785787535.486901:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:2388:x1872533744787328:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 35us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787535.486908:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 200 00010000:00010000:0.0:1785787535.863633:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787536.887722:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787537.331974:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905faf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533769985920:0@lo:400:kworker.0 00000100:00100000:3.0:1785787537.332037:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787537.332083:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905faf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533769986432:0@lo:400:kworker.0 00000100:00100000:3.0:1785787537.332108:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787537.332141:0:3334:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1785787537.332147:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905faf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533769985792:0@lo:400:kworker.0 00000100:00100000:3.0:1785787537.332172:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787537.332193:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905faf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3334:1872533769986304:0@lo:400:kworker.0 00000100:00100000:3.0:1785787537.332211:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787537.332243:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905faf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533769986048:0@lo:400:kworker.0 00000100:00100000:3.0:1785787537.332266:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787537.332282:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785787537.332287:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905faf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769986176:0@lo:400:kworker.0 00000100:00100000:3.0:1785787537.332307:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787537.332337:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769985920 00000100:00100000:3.0:1785787537.332344:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769985920 00000100:00100000:3.0:1785787537.332377:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769986304 00000100:00100000:3.0:1785787537.332380:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769986304 00000100:00100000:3.0:1785787537.332399:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769986048 00000100:00100000:3.0:1785787537.332402:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769986048 00000100:00100000:3.0:1785787537.332418:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1785787537.332426:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533769985920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787537.332471:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533769985920:12345-0@lo:400:kworker.0 Request processed in 46us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787537.332478:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1785787537.332492:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1785787537.332509:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3334:x1872533769986304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787537.332535:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3334:x1872533769986304:12345-0@lo:400:kworker.0 Request processed in 37us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787537.332540:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1785787537.332550:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1785787537.332555:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533769986048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787537.332578:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533769986048:12345-0@lo:400:kworker.0 Request processed in 23us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787537.332584:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1785787537.332599:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769986432 00000100:00100000:3.0:1785787537.332607:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769986432 00000100:00100000:3.0:1785787537.332630:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769986176 00000100:00100000:3.0:1785787537.332632:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769986176 00000100:00100000:3.0:1785787537.332643:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1785787537.332649:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533769986432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787537.332678:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533769986432:12345-0@lo:400:kworker.0 Request processed in 29us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787537.332684:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1785787537.332695:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1785787537.332700:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769986176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787537.332725:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769986176:12345-0@lo:400:kworker.0 Request processed in 25us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787537.332731:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1785787537.332747:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769985792 00000100:00100000:3.0:1785787537.332750:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769985792 00000100:00100000:3.0:1785787537.332789:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1785787537.332794:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+19:3334:x1872533769985792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787537.332818:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+19:3334:x1872533769985792:12345-0@lo:400:kworker.0 Request processed in 23us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787537.332824:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:3.0:1785787537.332865:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785787537.332869:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785787537.332871:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785787537.332889:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905faf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533769985792:0@lo:400:kworker.0 00000100:00100000:3.0:1785787537.332900:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905faf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3334:1872533769986304:0@lo:400:kworker.0 00000100:00100000:3.0:1785787537.332908:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905faf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533769985920:0@lo:400:kworker.0 00010000:00080000:3.0:1785787537.332926:0:3334:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91905faf4a80 x1872533769986432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787537.332936:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905faf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533769986432:0@lo:400:kworker.0 00010000:00080000:3.0:1785787537.332958:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91905faf6a00 x1872533769986176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787537.332966:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905faf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769986176:0@lo:400:kworker.0 00000100:00100000:3.0:1785787537.332973:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905faf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533769986048:0@lo:400:kworker.0 00000100:00100000:0.0:1785787537.843021:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785787537.843040:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076edc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769986560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785787537.843101:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787537.843169:0:6621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769986560 00000100:00100000:0.0:1785787537.843176:0:6621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769986560 00000100:00100000:0.0:1785787537.843219:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1785787537.843228:0:6621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769986560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785787537.843261:0:6621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785787537.843303:0:6621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769986560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787537.843310:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1785787537.843349:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076edc700 x1872533769986560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787553 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787537.843365:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076edc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769986560:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785787537.910094:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787538.931984:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785787539.903202:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785787539.903230:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769986688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785787539.903317:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787539.906131:0:8140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769986688 00000100:00100000:0.0:1785787539.906146:0:8140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769986688 00000100:00100000:0.0:1785787539.906221:0:8140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1785787539.906232:0:8140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b377800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769986688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785787539.906276:0:8140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785787539.906362:0:8140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b377800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769986688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (3044us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787539.906369:0:8140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1785787539.906415:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907b376a00 x1872533769986688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787555 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787539.906456:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769986688:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1785787539.906904:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1785787539.968100:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1785787540.304805:0:8931:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg353-server.virtnet: executing yml_node 00000100:00100000:0.0:1785787540.624822:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787540.624900:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787540.625399:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744787712 00000100:00100000:0.0:1785787540.625411:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744787712 00000100:00080000:2.0:1785787540.629322:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785787540.629908:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744787584 00000100:00100000:1.0:1785787540.629921:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744787584 00000100:00100000:1.0:1785787540.629997:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 202 00000100:00100000:1.0:1785787540.630032:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:2391:x1872533744787584:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1785787540.630124:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:2391:x1872533744787584:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 104us (5318us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787540.630130:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 202 00000100:00100000:0.0:1785787540.634141:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 51 00000100:00100000:0.0:1785787540.634164:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076edc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+6:2391:x1872533744787712:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1785787540.634257:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076edc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+6:2391:x1872533744787712:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 105us (9356us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787540.634265:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 51 00010000:00010000:2.0:1785787540.979055:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787542.004166:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787542.456617:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533769986816:0@lo:400:kworker.0 00000100:00100000:1.0:1785787542.456639:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fe15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533769987072:0@lo:400:kworker.0 00000100:00100000:2.0:1785787542.456735:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533769986944:0@lo:400:kworker.0 00000100:00100000:1.0:1785787542.461075:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787542.461160:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785787542.461173:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fe14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769987200:0@lo:400:kworker.0 00000100:00100000:1.0:1785787542.461214:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787542.462600:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769987072 00000100:00100000:3.0:1785787542.462618:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769987072 00000100:00100000:3.0:1785787542.462695:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1785787542.462707:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905069d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533769987072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787542.462782:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905069d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533769987072:12345-0@lo:400:kworker.0 Request processed in 78us (1714us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787542.462789:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1785787542.462814:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769987200 00000100:00100000:3.0:1785787542.462818:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769987200 00000100:00100000:3.0:1785787542.462879:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1785787542.462885:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905069e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769987200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787542.462914:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905069e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769987200:12345-0@lo:400:kworker.0 Request processed in 29us (1700us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787542.462919:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1785787542.462955:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907fe14380 x1872533769987200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787542.463197:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fe14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769987200:0@lo:400:kworker.0 00000100:00100000:3.0:1785787542.463215:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fe15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533769987072:0@lo:400:kworker.0 00000100:00080000:2.0:1785787542.463445:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1785787542.463451:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785787542.463492:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787542.463517:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769986944 00000100:00100000:2.0:1785787542.463520:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769986944 00000100:00100000:2.0:1785787542.463544:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1785787542.463549:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533769986944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787542.463582:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533769986944:12345-0@lo:400:kworker.0 Request processed in 33us (90us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787542.463587:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1785787542.463614:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533769986944:0@lo:400:kworker.0 00000100:00100000:2.0:1785787542.463623:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905069ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533769987456:0@lo:400:kworker.0 00000100:00100000:2.0:1785787542.463645:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787542.463664:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769987456 00000100:00100000:2.0:1785787542.463667:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769987456 00000100:00100000:2.0:1785787542.463690:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1785787542.463695:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533769987456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787542.463736:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533769987456:12345-0@lo:400:kworker.0 Request processed in 41us (89us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787542.463741:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1785787542.463752:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1785787542.463778:0:3334:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91905069ca80 x1872533769987456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787542.463790:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905069ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533769987456:0@lo:400:kworker.0 00000100:00100000:0.0:1785787542.469586:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787542.469803:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fe17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3333:1872533769987328:0@lo:400:kworker.0 00000100:00100000:1.0:1785787542.469882:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787542.470136:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769986816 00000100:00100000:3.0:1785787542.470146:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769986816 00000100:00100000:3.0:1785787542.470220:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1785787542.470230:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+19:3333:x1872533769986816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787542.470290:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+19:3333:x1872533769986816:12345-0@lo:400:kworker.0 Request processed in 62us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787542.470297:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1785787542.470345:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533769986816:0@lo:400:kworker.0 00000100:00100000:0.0:1785787542.471083:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769987328 00000100:00100000:0.0:1785787542.471088:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769987328 00000100:00100000:0.0:1785787542.471143:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1785787542.471150:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905069ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1872533769987328:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1785787542.471165:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785787542.471204:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905069ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1872533769987328:12345-0@lo:400:kworker.0 Request processed in 54us (1321us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787542.471210:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1785787542.471426:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fe17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3333:1872533769987328:0@lo:400:kworker.0 00000100:00100000:3.0:1785787542.963397:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076edc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769987584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785787542.963505:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787542.963645:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769987584 00000100:00100000:2.0:1785787542.963655:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769987584 00000100:00100000:2.0:1785787542.963729:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1785787542.963738:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769987584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785787542.963780:0:6620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785787542.979592:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769987584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 15838us (16070us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787542.979611:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1785787542.989868:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076edc380 x1872533769987584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787558 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787542.989903:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076edc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769987584:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1785787543.027274:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787544.055232:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787545.012797:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905069e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769987712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785787545.012877:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787545.012939:0:6621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769987712 00000100:00100000:1.0:1785787545.012948:0:6621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769987712 00000100:00100000:1.0:1785787545.013007:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1785787545.013018:0:6621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076edfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769987712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785787545.013051:0:6621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785787545.013099:0:6621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076edfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769987712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787545.013107:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1785787545.013155:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91905069e300 x1872533769987712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787561 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787545.013191:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905069e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769987712:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1785787545.014689:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1785787545.075736:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787545.748144:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787545.748199:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787545.748286:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744787968 00000100:00100000:1.0:1785787545.748295:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744787968 00000100:00100000:1.0:1785787545.748364:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 55 00000100:00100000:1.0:1785787545.748373:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+6:2388:x1872533744787968:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1785787545.748451:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+6:2388:x1872533744787968:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 79us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787545.748459:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 55 00000100:00100000:2.0:1785787545.748652:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744787840 00000100:00100000:2.0:1785787545.748656:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744787840 00000100:00100000:2.0:1785787545.748694:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 204 00000100:00100000:2.0:1785787545.748702:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:2388:x1872533744787840:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:2.0:1785787545.748734:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:2388:x1872533744787840:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 33us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787545.748740:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 204 00000100:00080000:3.0:1785787545.749976:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1785787546.080160:0:9124:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.56.1 00010000:00010000:1.0:1785787546.104323:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787547.122995:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787547.571160:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905faf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533769988096:0@lo:400:kworker.0 00000100:00100000:0.0:1785787547.571228:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787547.571300:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785787547.571319:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905faf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769988224:0@lo:400:kworker.0 00000100:00100000:0.0:1785787547.571345:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787547.571422:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769988096 00000100:00100000:3.0:1785787547.571440:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769988096 00000100:00100000:3.0:1785787547.571497:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1785787547.571508:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ede680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533769988096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787547.571569:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ede680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533769988096:12345-0@lo:400:kworker.0 Request processed in 63us (340us total) trans 0 rc 0/0 00000100:00080000:0.0:1785787547.571657:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785787547.571740:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1785787547.571765:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769988224 00000100:00100000:3.0:1785787547.571769:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769988224 00000100:00100000:1.0:1785787547.571845:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905faf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533769987840:0@lo:400:kworker.0 00000100:00100000:1.0:1785787547.571875:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787547.571899:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905faf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3333:1872533769988352:0@lo:400:kworker.0 00000100:00100000:1.0:1785787547.571921:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787547.571938:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1785787547.571943:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905faf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1872533769987968:0@lo:400:kworker.0 00000100:00100000:1.0:1785787547.571962:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787547.571977:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905faf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533769988480:0@lo:400:kworker.0 00000100:00100000:1.0:1785787547.571999:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787547.572024:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769988352 00000100:00100000:1.0:1785787547.572028:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769988352 00000100:00100000:3.0:1785787547.572489:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769988480 00000100:00100000:3.0:1785787547.572493:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769988480 00000100:00100000:2.0:1785787547.572536:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1785787547.572546:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769988224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787547.572592:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769988224:12345-0@lo:400:kworker.0 Request processed in 48us (1246us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787547.572599:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1785787547.572703:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785787547.572707:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785787547.572709:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785787547.574820:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769987968 00000100:00100000:1.0:1785787547.574840:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769987968 00000100:00100000:1.0:1785787547.574859:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1785787547.574867:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905069e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1872533769988352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787547.574943:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905069e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1872533769988352:12345-0@lo:400:kworker.0 Request processed in 76us (3020us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787547.574951:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1785787547.574964:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1785787547.574970:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905069f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1872533769987968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787547.574997:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905069f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1872533769987968:12345-0@lo:400:kworker.0 Request processed in 27us (3034us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787547.575003:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1785787547.575025:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769987840 00000100:00100000:1.0:1785787547.575029:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769987840 00000100:00100000:1.0:1785787547.575055:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1785787547.575061:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+19:3333:x1872533769987840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787547.575090:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+19:3333:x1872533769987840:12345-0@lo:400:kworker.0 Request processed in 29us (3214us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787547.575096:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1785787547.576516:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905faf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1872533769987968:0@lo:400:kworker.0 00000100:00100000:2.0:1785787547.576530:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905faf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533769987840:0@lo:400:kworker.0 00000100:00100000:2.0:1785787547.576555:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905faf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3333:1872533769988352:0@lo:400:kworker.0 00000100:00100000:3.0:1785787547.578780:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1785787547.578794:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905069df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533769988480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787547.578875:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905069df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533769988480:12345-0@lo:400:kworker.0 Request processed in 86us (6875us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787547.578881:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1785787547.578921:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91905faf6d80 x1872533769988224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787547.578934:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905faf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769988224:0@lo:400:kworker.0 00000100:00100000:3.0:1785787547.578947:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905faf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533769988096:0@lo:400:kworker.0 00010000:00080000:1.0:1785787547.579682:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91905faf4700 x1872533769988480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787547.579693:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905faf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533769988480:0@lo:400:kworker.0 00000100:00100000:3.0:1785787548.083261:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076edf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769988608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785787548.083331:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787548.085684:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769988608 00000100:00100000:2.0:1785787548.085695:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769988608 00000100:00100000:2.0:1785787548.085752:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1785787548.085762:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769988608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785787548.085798:0:6620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785787548.085894:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769988608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (2561us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787548.085901:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1785787548.086027:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076edf100 x1872533769988608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787564 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787548.086046:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076edf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769988608:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1785787548.147076:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787549.184646:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1785787549.336956:0:9221:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.56.1 00000100:00100000:3.0:1785787550.132502:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785787550.132526:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076ec9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769988736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785787550.132590:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787550.132818:0:8140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769988736 00000100:00100000:2.0:1785787550.132849:0:8140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769988736 00000100:00100000:2.0:1785787550.132906:0:8140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1785787550.132915:0:8140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769988736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785787550.132946:0:8140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785787550.132990:0:8140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769988736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787550.132996:0:8140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1785787550.133030:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076ec9500 x1872533769988736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787566 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787550.133044:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076ec9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769988736:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1785787550.133260:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1785787550.194986:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787550.855702:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787550.855748:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787550.855806:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744788096 00000100:00100000:1.0:1785787550.855816:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744788096 00000100:00100000:1.0:1785787550.855890:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 206 00000100:00100000:1.0:1785787550.855900:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:2388:x1872533744788096:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1785787550.855964:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:2388:x1872533744788096:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 66us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787550.855978:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 206 00000100:00100000:1.0:1785787550.856010:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744788224 00000100:00100000:1.0:1785787550.856014:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744788224 00000100:00100000:1.0:1785787550.856056:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 59 00000100:00100000:1.0:1785787550.856063:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+6:2388:x1872533744788224:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1785787550.856111:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+6:2388:x1872533744788224:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 48us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787550.856117:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 59 00000100:00080000:1.0:1785787550.856223:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1785787551.219245:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787552.243514:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787552.694232:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076edf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533769988864:0@lo:400:kworker.0 00000100:00100000:3.0:1785787552.694300:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787552.702752:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785787552.702774:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076edc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1872533769988992:0@lo:400:kworker.0 00000100:00100000:3.0:1785787552.702901:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787552.702955:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769988864 00000100:00100000:3.0:1785787552.702963:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769988864 00000100:00100000:3.0:1785787552.703007:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1785787552.703015:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+19:3333:x1872533769988864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787552.703066:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+19:3333:x1872533769988864:12345-0@lo:400:kworker.0 Request processed in 51us (8766us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787552.703073:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1785787552.703104:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769988992 00000100:00100000:3.0:1785787552.703108:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769988992 00000100:00100000:3.0:1785787552.703132:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1785787552.703139:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1872533769988992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787552.703188:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1872533769988992:12345-0@lo:400:kworker.0 Request processed in 49us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787552.703194:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1785787552.703237:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076edc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1872533769988992:0@lo:400:kworker.0 00000100:00100000:3.0:1785787552.703248:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076edf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533769988864:0@lo:400:kworker.0 00000100:00100000:3.0:1785787552.704994:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076edf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533769989120:0@lo:400:kworker.0 00000100:00100000:3.0:1785787552.705052:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787552.706051:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769989120 00000100:00100000:1.0:1785787552.706058:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769989120 00000100:00100000:1.0:1785787552.706106:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1785787552.706115:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533769989120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787552.710208:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076edc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769989248:0@lo:400:kworker.0 00000100:00100000:2.0:1785787552.710229:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3333:1872533769989376:0@lo:400:kworker.0 00000100:00100000:0.0:1785787552.710271:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787552.710272:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787552.728872:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076edf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533769989120:0@lo:400:kworker.0 00000100:00100000:3.0:1785787552.734683:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533769989504:0@lo:400:kworker.0 00000100:00100000:2.0:1785787552.734823:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1785787552.734854:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1785787552.734862:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769989248 00000100:00100000:0.0:1785787552.734869:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769989248 00000100:00100000:0.0:1785787552.734919:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1785787552.734928:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769989248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787552.734967:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769989376 00000100:00100000:2.0:1785787552.734983:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769989376 00000100:00100000:0.0:1785787552.734992:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769989248:12345-0@lo:400:kworker.0 Request processed in 66us (24722us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787552.734999:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1785787552.735006:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1785787552.735012:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1785787552.735018:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ec9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1872533769989376:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1785787552.735037:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076edc380 x1872533769989248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787568 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787552.735051:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076edc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769989248:0@lo:400:kworker.0 00000100:00100000:2.0:1785787552.735052:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ec9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1872533769989376:12345-0@lo:400:kworker.0 Request processed in 34us (24778us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787552.735058:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1785787552.735082:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3333:1872533769989376:0@lo:400:kworker.0 00000100:00080000:0.0:1785787552.738055:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785787552.738067:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785787552.750230:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533769989120:12345-0@lo:400:kworker.0 Request processed in 44106us (45168us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787552.750245:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1785787552.760224:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787552.760266:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769989504 00000100:00100000:3.0:1785787552.760275:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769989504 00000100:00100000:3.0:1785787552.760330:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1785787552.760340:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533769989504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787552.760408:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533769989504:12345-0@lo:400:kworker.0 Request processed in 69us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787552.760416:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1785787552.760436:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1785787552.762215:0:3334:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919077714000 x1872533769989504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787568 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787552.762231:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533769989504:0@lo:400:kworker.0 00000100:00100000:2.0:1785787553.206548:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769989632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785787553.206624:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787553.206755:0:6621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769989632 00000100:00100000:0.0:1785787553.206764:0:6621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769989632 00000100:00100000:0.0:1785787553.206811:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1785787553.206821:0:6621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769989632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785787553.206881:0:6621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785787553.206924:0:6621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769989632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787553.206936:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1785787553.207783:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919077715500 x1872533769989632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787569 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787553.207803:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769989632:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1785787553.272880:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1785787553.408659:0:9320:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.56.1 00010000:00010000:3.0:1785787554.293044:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785787555.260460:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785787555.260480:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905069c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769989760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785787555.260550:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787555.261953:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769989760 00000100:00100000:1.0:1785787555.261963:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769989760 00000100:00080000:3.0:1785787555.262011:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785787555.262027:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1785787555.262037:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769989760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785787555.262070:0:6620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785787555.262971:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769989760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 933us (2418us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787555.262980:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1785787555.263098:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91905069c700 x1872533769989760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787571 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787555.263119:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905069c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769989760:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1785787555.320510:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1785787555.955594:0:9368:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Aug 3 16:05:53 EDT 2026 00000100:00100000:2.0:1785787556.001993:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787556.002032:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787556.002095:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744788352 00000100:00100000:3.0:1785787556.002104:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744788352 00000100:00100000:3.0:1785787556.002161:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 208 00000100:00100000:3.0:1785787556.002171:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:2391:x1872533744788352:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1785787556.002239:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:2391:x1872533744788352:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 61us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787556.002247:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 208 00000100:00100000:0.0:1785787556.004979:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744788480 00000100:00100000:0.0:1785787556.004992:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744788480 00000100:00100000:0.0:1785787556.005058:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 63 00000100:00100000:0.0:1785787556.005067:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+6:2391:x1872533744788480:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1785787556.005152:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+6:2391:x1872533744788480:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 86us (3118us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787556.005159:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 63 00000100:00080000:3.0:1785787556.005580:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1785787556.339038:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787557.365346:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787557.815001:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905faf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533769989888:0@lo:400:kworker.0 00000100:00100000:3.0:1785787557.815061:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787557.815122:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769989888 00000100:00100000:3.0:1785787557.815129:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769989888 00000100:00100000:3.0:1785787557.815170:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1785787557.815179:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+19:3333:x1872533769989888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787557.815227:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+19:3333:x1872533769989888:12345-0@lo:400:kworker.0 Request processed in 49us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787557.815234:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1785787557.815276:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905faf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533769989888:0@lo:400:kworker.0 00000100:00100000:3.0:1785787557.818545:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905faf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533769990016:0@lo:400:kworker.0 00000100:00100000:3.0:1785787557.818641:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787557.818700:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785787557.818707:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905faf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3336:1872533769990144:0@lo:400:kworker.0 00000100:00100000:3.0:1785787557.818726:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787557.819921:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769990016 00000100:00100000:2.0:1785787557.819929:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769990016 00000100:00100000:2.0:1785787557.819980:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769990144 00000100:00100000:2.0:1785787557.819982:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769990144 00000100:00100000:2.0:1785787557.820031:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1785787557.820044:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533769990016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787557.820112:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533769990016:12345-0@lo:400:kworker.0 Request processed in 68us (1471us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787557.820118:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1785787557.820136:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1785787557.820142:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3336:x1872533769990144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787557.820168:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3336:x1872533769990144:12345-0@lo:400:kworker.0 Request processed in 26us (1440us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787557.820174:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1785787557.820197:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785787557.820846:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905faf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533769990016:0@lo:400:kworker.0 00000100:00100000:3.0:1785787557.821086:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076edc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769990272:0@lo:400:kworker.0 00000100:00100000:3.0:1785787557.821123:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787557.821155:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905faf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3336:1872533769990144:0@lo:400:kworker.0 00000100:00100000:3.0:1785787557.821526:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fe17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3333:1872533769990400:0@lo:400:kworker.0 00000100:00100000:3.0:1785787557.821553:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787557.821592:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785787557.821598:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fe14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533769990528:0@lo:400:kworker.0 00000100:00100000:3.0:1785787557.821641:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787557.821667:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769990272 00000100:00100000:3.0:1785787557.821671:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769990272 00000100:00100000:3.0:1785787557.821703:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769990528 00000100:00100000:3.0:1785787557.821706:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769990528 00000100:00100000:3.0:1785787557.821721:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1785787557.821727:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076edf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769990272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787557.821914:0:6619:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1785787557.821922:0:6619:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:2.0:1785787557.821942:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785787557.821945:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785787557.821951:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769990400 00000100:00100000:2.0:1785787557.821955:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769990400 00000100:00100000:2.0:1785787557.821980:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1785787557.821986:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1872533769990400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787557.822019:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1872533769990400:12345-0@lo:400:kworker.0 Request processed in 34us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787557.822025:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1785787557.822052:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fe17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3333:1872533769990400:0@lo:400:kworker.0 00000100:00080000:2.0:1785787557.822069:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785787557.823428:0:6617:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1785787557.823440:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1785787557.823448:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ecc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533769990528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787557.823497:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ecc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533769990528:12345-0@lo:400:kworker.0 Request processed in 50us (1855us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787557.823505:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1785787557.823537:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907fe14380 x1872533769990528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787557.823548:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fe14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533769990528:0@lo:400:kworker.0 00000100:00100000:3.0:1785787557.823615:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076edf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769990272:12345-0@lo:400:kworker.0 Request processed in 34us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787557.823623:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1785787557.823651:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076edc380 x1872533769990272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787557.823661:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076edc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769990272:0@lo:400:kworker.0 00000100:00100000:3.0:1785787558.325195:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076ecb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769990656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785787558.325262:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787558.325419:0:8140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769990656 00000100:00100000:2.0:1785787558.325427:0:8140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769990656 00000100:00100000:2.0:1785787558.325973:0:8140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1785787558.325984:0:8140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769990656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785787558.326017:0:8140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785787558.326064:0:8140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769990656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787558.326070:0:8140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1785787558.328677:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076ecb100 x1872533769990656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787574 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787558.328700:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076ecb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769990656:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1785787558.386964:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787559.413982:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787560.380987:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905069d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769990784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785787560.381075:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787560.381279:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769990784 00000100:00100000:1.0:1785787560.381287:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769990784 00000100:00100000:1.0:1785787560.381359:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1785787560.381376:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ecea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769990784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785787560.381408:0:6620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785787560.381465:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ecea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769990784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787560.381472:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1785787560.381747:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1785787560.381778:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91905069d880 x1872533769990784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787576 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787560.381798:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905069d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769990784:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1785787560.435100:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787561.087630:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787561.087685:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787561.087890:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744788608 00000100:00100000:1.0:1785787561.087900:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744788608 00000100:00100000:1.0:1785787561.087957:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 210 00000100:00100000:1.0:1785787561.087968:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:2389:x1872533744788608:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1785787561.088036:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:2389:x1872533744788608:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 70us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787561.088044:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 210 00000100:00100000:2.0:1785787561.089580:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744788736 00000100:00100000:2.0:1785787561.089589:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744788736 00000100:00100000:2.0:1785787561.089651:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 67 00000100:00100000:2.0:1785787561.089660:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+6:2389:x1872533744788736:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:2.0:1785787561.089715:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+6:2389:x1872533744788736:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 56us (2094us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787561.089722:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 67 00000100:00080000:0.0:1785787561.089806:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1785787561.459981:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787562.483295:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787562.931333:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076ec9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533769990912:0@lo:400:kworker.0 00000100:00100000:0.0:1785787562.931424:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787562.931489:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076ecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3333:1872533769991424:0@lo:400:kworker.0 00000100:00100000:0.0:1785787562.931520:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787562.931549:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1785787562.931554:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076ec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1872533769991040:0@lo:400:kworker.0 00000100:00100000:0.0:1785787562.931572:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787562.931589:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076ec9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533769991552:0@lo:400:kworker.0 00000100:00100000:0.0:1785787562.931611:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787562.931642:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769991424 00000100:00100000:0.0:1785787562.931651:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769991424 00000100:00100000:0.0:1785787562.931722:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769991040 00000100:00100000:0.0:1785787562.931725:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769991040 00000100:00100000:0.0:1785787562.931745:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1785787562.931753:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1872533769991424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787562.931806:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1872533769991424:12345-0@lo:400:kworker.0 Request processed in 53us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787562.931814:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1785787562.931853:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1785787562.931859:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1872533769991040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787562.931883:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1872533769991040:12345-0@lo:400:kworker.0 Request processed in 24us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787562.931889:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1785787562.931908:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769991552 00000100:00100000:0.0:1785787562.931912:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769991552 00000100:00100000:0.0:1785787562.931936:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1785787562.931942:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533769991552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787562.931968:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533769991552:12345-0@lo:400:kworker.0 Request processed in 26us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787562.931974:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1785787562.931987:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785787562.931992:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785787562.932027:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076ec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1872533769991040:0@lo:400:kworker.0 00010000:00080000:0.0:1785787562.932038:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076ec9c00 x1872533769991552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787562.932050:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076ec9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533769991552:0@lo:400:kworker.0 00000100:00100000:0.0:1785787562.932058:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076ecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3333:1872533769991424:0@lo:400:kworker.0 00000100:00100000:1.0:1785787562.932145:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076ecb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533769991168:0@lo:400:kworker.0 00000100:00100000:1.0:1785787562.932175:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787562.932203:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785787562.932209:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076ec9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769991296:0@lo:400:kworker.0 00000100:00100000:1.0:1785787562.932228:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787562.932253:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769991296 00000100:00100000:1.0:1785787562.932256:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769991296 00000100:00100000:2.0:1785787562.933877:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769990912 00000100:00100000:2.0:1785787562.933889:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769990912 00000100:00100000:2.0:1785787562.933947:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1785787562.933956:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+19:3333:x1872533769990912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787562.934044:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+19:3333:x1872533769990912:12345-0@lo:400:kworker.0 Request processed in 89us (2618us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787562.934051:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00080000:0.0:1785787562.934460:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785787562.934475:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769991168 00000100:00100000:0.0:1785787562.934480:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769991168 00000100:00100000:0.0:1785787562.934530:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1785787562.934536:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905069d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533769991168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787562.934581:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905069d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533769991168:12345-0@lo:400:kworker.0 Request processed in 45us (2405us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787562.934587:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1785787562.934636:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076ecb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533769991168:0@lo:400:kworker.0 00000100:00100000:0.0:1785787562.934667:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076ec9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533769990912:0@lo:400:kworker.0 00000100:00100000:3.0:1785787562.935347:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1785787562.935363:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905069f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769991296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787562.935407:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905069f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769991296:12345-0@lo:400:kworker.0 Request processed in 52us (3178us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787562.935414:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1785787562.935842:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1785787562.936433:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076ec9880 x1872533769991296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787562.936448:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076ec9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769991296:0@lo:400:kworker.0 00000100:00100000:2.0:1785787563.444070:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785787563.444092:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076ec9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769991680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785787563.444162:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787563.444330:0:8140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769991680 00000100:00100000:2.0:1785787563.444338:0:8140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769991680 00000100:00100000:2.0:1785787563.444397:0:8140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1785787563.444407:0:8140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769991680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785787563.444443:0:8140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785787563.444593:0:8140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769991680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 185us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787563.444602:0:8140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1785787563.444684:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076ec9180 x1872533769991680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787579 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787563.444704:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076ec9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769991680:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785787563.506982:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787564.531363:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787565.491117:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785787565.491140:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076ec9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769991808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785787565.491206:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787565.491312:0:6621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769991808 00000100:00100000:2.0:1785787565.491320:0:6621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769991808 00000100:00100000:2.0:1785787565.491375:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1785787565.491383:0:6621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ecc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769991808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785787565.491414:0:6621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785787565.491460:0:6621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ecc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769991808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787565.491467:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1785787565.491503:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076ec9180 x1872533769991808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787581 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787565.491519:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076ec9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769991808:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1785787565.491577:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1785787565.557294:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787566.218669:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787566.218711:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787566.218816:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744788864 00000100:00100000:1.0:1785787566.218842:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744788864 00000100:00100000:1.0:1785787566.218890:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 212 00000100:00100000:1.0:1785787566.218900:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:2390:x1872533744788864:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1785787566.218975:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:2390:x1872533744788864:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 75us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787566.218983:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 212 00000100:00100000:2.0:1785787566.219646:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744788992 00000100:00100000:2.0:1785787566.219652:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744788992 00000100:00100000:2.0:1785787566.219709:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 71 00000100:00100000:2.0:1785787566.219717:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+6:2390:x1872533744788992:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:2.0:1785787566.219770:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+6:2390:x1872533744788992:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 53us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787566.219777:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 71 00000100:00080000:0.0:1785787566.219978:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1785787566.579003:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787567.602967:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787568.051226:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905069dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533769991936:0@lo:400:kworker.0 00000100:00100000:0.0:1785787568.051302:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787568.051372:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769991936 00000100:00100000:0.0:1785787568.051379:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769991936 00000100:00100000:0.0:1785787568.051433:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1785787568.051440:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+19:3333:x1872533769991936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787568.051491:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+19:3333:x1872533769991936:12345-0@lo:400:kworker.0 Request processed in 50us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787568.051498:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1785787568.051546:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905069dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533769991936:0@lo:400:kworker.0 00000100:00100000:0.0:1785787568.051803:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905069c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769992320:0@lo:400:kworker.0 00000100:00100000:0.0:1785787568.051858:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787568.051882:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785787568.051888:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905069ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3336:1872533769992192:0@lo:400:kworker.0 00000100:00100000:0.0:1785787568.051912:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787568.051938:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769992192 00000100:00100000:0.0:1785787568.051942:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769992192 00000100:00100000:0.0:1785787568.051977:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1785787568.051983:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3336:x1872533769992192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787568.052030:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3336:x1872533769992192:12345-0@lo:400:kworker.0 Request processed in 36us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787568.052038:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1785787568.052058:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785787568.052082:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905069ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3336:1872533769992192:0@lo:400:kworker.0 00000100:00100000:0.0:1785787568.052098:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905069fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3333:1872533769992448:0@lo:400:kworker.0 00000100:00100000:0.0:1785787568.052121:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787568.052140:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1785787568.052256:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905069f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1872533769992064:0@lo:400:kworker.0 00000100:00100000:0.0:1785787568.052293:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787568.052320:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905069ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533769992576:0@lo:400:kworker.0 00000100:00100000:0.0:1785787568.052341:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787568.052367:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769992448 00000100:00100000:0.0:1785787568.052370:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769992448 00000100:00100000:0.0:1785787568.052395:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769992064 00000100:00100000:0.0:1785787568.052398:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769992064 00000100:00100000:0.0:1785787568.052417:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1785787568.052423:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1872533769992448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787568.052459:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1872533769992448:12345-0@lo:400:kworker.0 Request processed in 36us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787568.052465:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1785787568.052478:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1785787568.052484:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1872533769992064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787568.052512:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1872533769992064:12345-0@lo:400:kworker.0 Request processed in 28us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787568.052518:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1785787568.052540:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769992320 00000100:00100000:0.0:1785787568.052543:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769992320 00000100:00100000:0.0:1785787568.052567:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769992576 00000100:00100000:0.0:1785787568.052571:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769992576 00000100:00100000:0.0:1785787568.052590:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1785787568.052596:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077714700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769992320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787568.052631:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077714700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769992320:12345-0@lo:400:kworker.0 Request processed in 34us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787568.052637:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1785787568.052648:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1785787568.052654:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077715c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533769992576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787568.052696:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077715c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533769992576:12345-0@lo:400:kworker.0 Request processed in 42us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787568.052702:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1785787568.052722:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785787568.052725:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785787568.052727:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1785787568.052747:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91905069c380 x1872533769992320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787568.052758:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905069c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769992320:0@lo:400:kworker.0 00000100:00100000:0.0:1785787568.052780:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905069f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1872533769992064:0@lo:400:kworker.0 00010000:00080000:0.0:1785787568.052789:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91905069ea00 x1872533769992576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787568.052798:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905069ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533769992576:0@lo:400:kworker.0 00000100:00100000:0.0:1785787568.052806:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905069fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3333:1872533769992448:0@lo:400:kworker.0 00000100:00100000:0.0:1785787568.563956:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785787568.563978:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077717480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769992704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785787568.564044:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787568.564098:0:8140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769992704 00000100:00100000:0.0:1785787568.564104:0:8140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769992704 00000100:00100000:0.0:1785787568.564144:0:8140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1785787568.564153:0:8140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077716d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769992704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785787568.564182:0:8140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785787568.564218:0:8140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077716d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769992704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787568.564238:0:8140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1785787568.564304:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919077717480 x1872533769992704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787584 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787568.564319:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077717480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769992704:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785787568.639288:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787569.656992:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785787570.615105:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785787570.615125:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905069c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769992832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785787570.615182:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787570.615236:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769992832 00000100:00100000:1.0:1785787570.615243:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769992832 00000100:00100000:1.0:1785787570.615301:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1785787570.615309:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905069fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769992832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785787570.615339:0:6620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785787570.615375:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905069fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769992832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787570.615382:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1785787570.615399:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1785787570.615422:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91905069c000 x1872533769992832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787586 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787570.615450:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905069c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769992832:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1785787570.674923:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785787571.332899:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787571.332942:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787571.332972:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744789248 00000100:00100000:1.0:1785787571.332981:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744789248 00000100:00100000:1.0:1785787571.333048:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 75 00000100:00100000:1.0:1785787571.333061:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905069c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+6:2390:x1872533744789248:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1785787571.333144:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905069c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+6:2390:x1872533744789248:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 86us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787571.333153:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 75 00000100:00100000:1.0:1785787571.333180:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744789120 00000100:00100000:1.0:1785787571.333184:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744789120 00000100:00100000:1.0:1785787571.333215:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 214 00000100:00100000:1.0:1785787571.333222:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:2390:x1872533744789120:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1785787571.333250:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:2390:x1872533744789120:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 29us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787571.333269:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 214 00000100:00080000:0.0:1785787571.333271:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1785787571.698988:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787572.724873:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785787573.172528:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905069c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533769993216:0@lo:400:kworker.0 00000100:00100000:1.0:1785787573.172589:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787573.172635:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785787573.172641:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905069ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769993344:0@lo:400:kworker.0 00000100:00100000:1.0:1785787573.172663:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787573.172693:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769993216 00000100:00100000:1.0:1785787573.172700:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769993216 00000100:00100000:1.0:1785787573.172745:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1785787573.172754:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905069c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533769993216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787573.172798:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905069c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533769993216:12345-0@lo:400:kworker.0 Request processed in 45us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787573.172805:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1785787573.172847:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769993344 00000100:00100000:1.0:1785787573.172851:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769993344 00000100:00100000:1.0:1785787573.172878:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1785787573.172884:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905069ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769993344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787573.172920:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905069ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769993344:12345-0@lo:400:kworker.0 Request processed in 36us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787573.172925:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1785787573.172938:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785787573.172942:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1785787573.172968:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91905069ed80 x1872533769993344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787589 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787573.172989:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905069ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769993344:0@lo:400:kworker.0 00000100:00100000:1.0:1785787573.172998:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905069c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533769993216:0@lo:400:kworker.0 00000100:00100000:0.0:1785787573.173062:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905069ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533769992960:0@lo:400:kworker.0 00000100:00100000:0.0:1785787573.173092:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787573.173120:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905069dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3333:1872533769993472:0@lo:400:kworker.0 00000100:00100000:0.0:1785787573.173149:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787573.173164:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1785787573.173168:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905069f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1872533769993088:0@lo:400:kworker.0 00000100:00100000:0.0:1785787573.173184:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787573.173196:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905069d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533769993600:0@lo:400:kworker.0 00000100:00100000:0.0:1785787573.173211:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787573.173231:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769993472 00000100:00100000:0.0:1785787573.173234:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769993472 00000100:00100000:0.0:1785787573.173266:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769993088 00000100:00100000:0.0:1785787573.173269:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769993088 00000100:00100000:0.0:1785787573.173281:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1785787573.173286:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1872533769993472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787573.173315:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1872533769993472:12345-0@lo:400:kworker.0 Request processed in 29us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787573.173320:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1785787573.173330:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1785787573.173335:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1872533769993088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787573.173363:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1872533769993088:12345-0@lo:400:kworker.0 Request processed in 28us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787573.173368:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1785787573.173389:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905069f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1872533769993088:0@lo:400:kworker.0 00000100:00100000:0.0:1785787573.173396:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905069dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3333:1872533769993472:0@lo:400:kworker.0 00000100:00100000:1.0:1785787573.173915:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769992960 00000100:00100000:1.0:1785787573.173920:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769992960 00000100:00100000:1.0:1785787573.173972:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1785787573.173978:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+19:3333:x1872533769992960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787573.174014:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+19:3333:x1872533769992960:12345-0@lo:400:kworker.0 Request processed in 37us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787573.174020:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1785787573.180434:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905069ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533769992960:0@lo:400:kworker.0 00000100:00100000:0.0:1785787573.182410:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769993600 00000100:00100000:0.0:1785787573.182420:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769993600 00000100:00100000:0.0:1785787573.182481:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1785787573.182490:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533769993600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787573.182565:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533769993600:12345-0@lo:400:kworker.0 Request processed in 77us (9352us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787573.182572:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1785787573.182599:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785787573.182603:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1785787573.182625:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91905069d880 x1872533769993600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787589 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787573.182638:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905069d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533769993600:0@lo:400:kworker.0 00000100:00100000:3.0:1785787573.685114:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785787573.685136:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769993728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785787573.685199:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787573.685326:0:6621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769993728 00000100:00100000:0.0:1785787573.685334:0:6621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769993728 00000100:00100000:0.0:1785787573.685385:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1785787573.685395:0:6621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ecca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769993728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785787573.685426:0:6621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785787573.685481:0:6621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ecca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769993728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787573.685494:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1785787573.685587:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919077716a00 x1872533769993728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787589 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787573.685606:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769993728:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785787573.748185:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787574.771033:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787575.731141:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905069c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769993856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785787575.731204:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787575.731383:0:8140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769993856 00000100:00100000:1.0:1785787575.731391:0:8140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769993856 00000100:00100000:1.0:1785787575.731453:0:8140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1785787575.731461:0:8140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ecd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769993856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785787575.731490:0:8140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785787575.731532:0:8140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ecd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769993856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787575.731538:0:8140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1785787575.731571:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91905069c380 x1872533769993856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787591 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787575.731603:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905069c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769993856:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1785787575.731699:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1785787575.804924:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787576.455696:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787576.455733:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787576.455877:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744789504 00000100:00100000:3.0:1785787576.455892:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744789504 00000100:00100000:3.0:1785787576.455951:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 79 00000100:00100000:3.0:1785787576.455960:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+6:2391:x1872533744789504:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1785787576.456031:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+6:2391:x1872533744789504:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 73us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787576.456038:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 79 00000100:00080000:0.0:1785787576.456298:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785787576.457180:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744789376 00000100:00100000:1.0:1785787576.457186:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744789376 00000100:00100000:1.0:1785787576.457237:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 216 00000100:00100000:1.0:1785787576.457245:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051539c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:2391:x1872533744789376:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1785787576.457287:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051539c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:2391:x1872533744789376:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 43us (1598us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787576.457294:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 216 00000001:02000400:1.0:1785787576.715104:0:9999:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 16:06:14 (1785787574) === 00010000:00010000:3.0:1785787576.821049:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787577.384152:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787577.384249:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744789632 00000100:00100000:1.0:1785787577.384259:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744789632 00000100:00100000:1.0:1785787577.384310:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 217 00000100:00100000:1.0:1785787577.384319:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051539450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:8153:x1872533744789632:12345-192.168.203.53@tcp:101:mount.lustre.0 00010000:00010000:1.0:1785787577.384333:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787577.384350:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919043c0ee00/0xe2c2ff68a6e84518 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd260 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787577.384376:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919043c0ee00/0xe2c2ff68a6e84518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd260 expref: 11 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787577.384386:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919043c0ee00/0xe2c2ff68a6e84518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd260 expref: 11 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787577.384395:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919043c0ee00, rc 0) 00000100:00100000:1.0:1785787577.384444:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051539450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+11:8153:x1872533744789632:12345-192.168.203.53@tcp:101:mount.lustre.0 Request processed in 126us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787577.384472:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 217 00000100:00100000:0.0:1785787577.399531:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787577.399694:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744789760 00000100:00100000:3.0:1785787577.399703:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744789760 00000100:00100000:3.0:1785787577.399748:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 218 00000100:00100000:3.0:1785787577.399757:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+11:8153:x1872533744789760:12345-192.168.203.53@tcp:501:mount.lustre.0 00000100:00100000:3.0:1785787577.400147:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+11:8153:x1872533744789760:12345-192.168.203.53@tcp:501:mount.lustre.0 Request processed in 390us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787577.400253:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 218 00000100:00100000:3.0:1785787577.407804:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787577.407951:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744789888 00000100:00100000:0.0:1785787577.407960:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744789888 00000100:00100000:0.0:1785787577.408012:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 219 00000100:00100000:0.0:1785787577.408022:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051538850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+11:8153:x1872533744789888:12345-192.168.203.53@tcp:503:mount.lustre.0 00000100:00100000:0.0:1785787577.408386:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051538850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+11:8153:x1872533744789888:12345-192.168.203.53@tcp:503:mount.lustre.0 Request processed in 365us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787577.408395:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 219 00000100:00100000:0.0:1785787577.418545:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787577.418685:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744790016 00000100:00100000:1.0:1785787577.418694:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744790016 00000100:00100000:1.0:1785787577.418745:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 220 00000100:00100000:1.0:1785787577.418754:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051538450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+11:8157:x1872533744790016:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1785787577.419025:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051538450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+11:8157:x1872533744790016:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 271us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787577.419033:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 220 00000100:00100000:1.0:1785787577.446822:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787577.446933:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744790144 00000100:00100000:3.0:1785787577.446942:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744790144 00000100:00100000:3.0:1785787577.447003:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 221 00000100:00100000:3.0:1785787577.447013:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051538c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+11:8157:x1872533744790144:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1785787577.447273:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051538c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+11:8157:x1872533744790144:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 261us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787577.447281:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 221 00000100:00100000:3.0:1785787577.452768:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787577.463932:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744790272 00000100:00100000:0.0:1785787577.463946:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744790272 00000100:00100000:0.0:1785787577.464135:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 222 00000100:00100000:0.0:1785787577.464146:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+11:8153:x1872533744790272:12345-192.168.203.53@tcp:101:mount.lustre.0 00010000:00010000:0.0:1785787577.464163:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787577.464181:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919050678200/0xe2c2ff68a6e8451f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd28a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787577.464209:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919050678200/0xe2c2ff68a6e8451f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd28a expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787577.464232:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919050678200/0xe2c2ff68a6e8451f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd28a expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787577.464258:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919050678200, rc 0) 00000100:00100000:0.0:1785787577.464328:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+12:8153:x1872533744790272:12345-192.168.203.53@tcp:101:mount.lustre.0 Request processed in 182us (11565us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787577.464336:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 222 00000100:00100000:0.0:1785787577.477558:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787577.477754:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744790400 00000100:00100000:1.0:1785787577.477763:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744790400 00000100:00100000:1.0:1785787577.477812:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 223 00000100:00100000:1.0:1785787577.477821:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+12:8153:x1872533744790400:12345-192.168.203.53@tcp:256:mount.lustre.0 20000000:01000000:1.0:1785787577.477884:0:5814:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1785787577.477907:0:5814:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1785787577.477911:0:5814:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1785787577.477913:0:5814:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1785787577.477915:0:5814:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1785787577.486004:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+12:8153:x1872533744790400:12345-192.168.203.53@tcp:256:mount.lustre.0 Request processed in 8166us (8435us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787577.486019:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 223 00000100:00100000:2.0:1785787577.498623:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787577.498713:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744790528 00000100:00100000:0.0:1785787577.498724:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744790528 00000100:00100000:0.0:1785787577.498774:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 224 00000100:00100000:0.0:1785787577.498783:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051539050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+12:8153:x1872533744790528:12345-192.168.203.53@tcp:101:mount.lustre.0 00010000:00010000:0.0:1785787577.498799:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787577.498816:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919050678c00/0xe2c2ff68a6e84526 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd291 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787577.500860:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919050678c00/0xe2c2ff68a6e84526 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd291 expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787577.500876:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919050678c00/0xe2c2ff68a6e84526 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd291 expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787577.500887:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919050678c00, rc 0) 00000100:00100000:1.0:1785787577.500940:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051539050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:8153:x1872533744790528:12345-192.168.203.53@tcp:101:mount.lustre.0 Request processed in 2158us (2326us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787577.501047:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 224 00000100:00100000:2.0:1785787577.502901:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787577.502964:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744790656 00000100:00100000:0.0:1785787577.502971:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744790656 00000100:00100000:0.0:1785787577.503018:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 225 00000100:00100000:0.0:1785787577.503027:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051538050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:8153:x1872533744790656:12345-192.168.203.53@tcp:501:mount.lustre.0 00000100:00100000:0.0:1785787577.503391:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051538050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:8153:x1872533744790656:12345-192.168.203.53@tcp:501:mount.lustre.0 Request processed in 363us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787577.503399:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 225 00000100:00100000:0.0:1785787577.505457:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787577.505592:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744790784 00000100:00100000:1.0:1785787577.505600:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744790784 00000100:00100000:1.0:1785787577.505643:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 226 00000100:00100000:1.0:1785787577.505652:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:8153:x1872533744790784:12345-192.168.203.53@tcp:503:mount.lustre.0 00000100:00100000:1.0:1785787577.506159:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:8153:x1872533744790784:12345-192.168.203.53@tcp:503:mount.lustre.0 Request processed in 447us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787577.506168:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 226 00000100:00100000:2.0:1785787577.515735:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787577.519455:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744790912 00000100:00100000:3.0:1785787577.519733:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744790912 00000100:00100000:2.0:1785787577.525751:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 227 00000100:00100000:2.0:1785787577.525766:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:8159:x1872533744790912:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1785787577.526031:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:8159:x1872533744790912:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 268us (10304us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787577.526040:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 227 00000100:00100000:3.0:1785787577.531678:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787577.537477:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744791040 00000100:00100000:0.0:1785787577.537502:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744791040 00000100:00100000:0.0:1785787577.537548:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 228 00000100:00100000:0.0:1785787577.537556:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051539850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:8159:x1872533744791040:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1785787577.537797:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051539850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:8159:x1872533744791040:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 240us (6134us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787577.537805:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 228 00000100:00100000:1.0:1785787577.557908:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787577.557932:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787577.558209:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744791168 00000100:00100000:0.0:1785787577.558227:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744791168 00000100:00100000:0.0:1785787577.558263:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744791552 00000100:00100000:0.0:1785787577.558266:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744791552 00000100:00100000:0.0:1785787577.558308:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 80 00000100:00100000:0.0:1785787577.558319:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905069ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+6:2391:x1872533744791552:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1785787577.558399:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905069ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+6:2391:x1872533744791552:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 82us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787577.558407:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 80 00000100:00100000:0.0:1785787577.558424:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 10 00000100:00100000:0.0:1785787577.558428:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905069c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2387:x1872533744791168:12345-192.168.203.53@tcp:38:mount.lustre.0 00010000:00080000:0.0:1785787577.558448:0:5820:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from f4ec65b7-e63e-42dc-becf-cba362002085@192.168.203.53@tcp t0 exp 0000000000000000 cur 364 last 0 00000020:00000080:0.0:1785787577.558487:0:5820:0:(genops.c:1406:class_connect()) connect: client f4ec65b7-e63e-42dc-becf-cba362002085, cookie 0xe2c2ff68a6e8452d 00000004:00100000:0.0:1785787577.558515:0:5820:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1785787577.573647:0:5820:0:(import.c:65:import_set_state_nolock()) ffff91905fadc800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1785787577.573979:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905069c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4ec65b7-e63e-42dc-becf-cba362002085+6:2387:x1872533744791168:12345-192.168.203.53@tcp:38:mount.lustre.0 Request processed in 15545us (16076us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787577.573988:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 10 00000100:00100000:1.0:1785787577.583664:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787577.583819:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744791296 00000100:00100000:0.0:1785787577.583861:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744791296 00000100:00100000:0.0:1785787577.583926:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 11 00000100:00100000:0.0:1785787577.583936:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905069d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4ec65b7-e63e-42dc-becf-cba362002085+6:0:x1872533744791296:12345-192.168.203.53@tcp:41:mount.lustre.0 00000004:00000024:0.0:1785787577.583982:0:9295:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1785787577.584090:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905069d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4ec65b7-e63e-42dc-becf-cba362002085+6:0:x1872533744791296:12345-192.168.203.53@tcp:41:mount.lustre.0 Request processed in 155us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787577.584098:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 11 00000100:00080000:2.0:1785787577.584367:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785787577.584513:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787577.584768:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744791424 00000100:00100000:2.0:1785787577.584773:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744791424 00000100:00100000:2.0:1785787577.584804:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 12 00000100:00100000:2.0:1785787577.584812:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905069ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4ec65b7-e63e-42dc-becf-cba362002085+6:8153:x1872533744791424:12345-192.168.203.53@tcp:41:mount.lustre.0 00000004:00000024:2.0:1785787577.584825:0:5821:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1785787577.584869:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905069ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4ec65b7-e63e-42dc-becf-cba362002085+6:8153:x1872533744791424:12345-192.168.203.53@tcp:41:mount.lustre.0 Request processed in 57us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787577.584886:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 12 00000100:00100000:3.0:1785787577.590455:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787577.593945:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744791680 00000100:00100000:0.0:1785787577.594006:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744791680 00000100:00100000:0.0:1785787577.594099:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 13 00000100:00100000:0.0:1785787577.594109:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4ec65b7-e63e-42dc-becf-cba362002085+6:8153:x1872533744791680:12345-192.168.203.53@tcp:40:mount.lustre.0 00000100:00100000:0.0:1785787577.594189:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4ec65b7-e63e-42dc-becf-cba362002085+6:8153:x1872533744791680:12345-192.168.203.53@tcp:40:mount.lustre.0 Request processed in 82us (3743us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787577.594196:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 13 00000100:00100000:3.0:1785787577.601055:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787577.601106:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787577.601134:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787577.601260:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744792064 00000100:00100000:1.0:1785787577.601270:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744792064 00000100:00100000:1.0:1785787577.601329:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 1 00000100:00100000:1.0:1785787577.601339:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4ec65b7-e63e-42dc-becf-cba362002085+6:8153:x1872533744792064:12345-192.168.203.53@tcp:33:mount.lustre.0 00000004:00200000:1.0:1785787577.601547:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1785787577.601686:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4ec65b7-e63e-42dc-becf-cba362002085+6:8153:x1872533744792064:12345-192.168.203.53@tcp:33:mount.lustre.0 Request processed in 348us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787577.601693:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 1 00000100:00100000:1.0:1785787577.601714:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744791808 00000100:00100000:1.0:1785787577.601724:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744791808 00000100:00100000:1.0:1785787577.601748:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744791936 00000100:00100000:1.0:1785787577.601751:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744791936 00000100:00100000:1.0:1785787577.601768:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 12 00000100:00100000:1.0:1785787577.601773:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ece300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2387:x1872533744791808:12345-192.168.203.53@tcp:8:mount.lustre.0 00010000:00080000:1.0:1785787577.601796:0:9394:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from f4ec65b7-e63e-42dc-becf-cba362002085@192.168.203.53@tcp t0 exp 0000000000000000 cur 364 last 0 00000020:00000080:1.0:1785787577.601822:0:9394:0:(genops.c:1406:class_connect()) connect: client f4ec65b7-e63e-42dc-becf-cba362002085, cookie 0xe2c2ff68a6e84534 00002000:00100000:1.0:1785787577.601858:0:9394:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f4ec65b7-e63e-42dc-becf-cba362002085/ffff91905fadb800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113801 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1785787577.601878:0:9394:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1785787577.602066:0:9394:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1785787577.602101:0:9394:0:(import.c:65:import_set_state_nolock()) ffff91907fe68800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1785787577.602132:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ece300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4ec65b7-e63e-42dc-becf-cba362002085+6:2387:x1872533744791808:12345-192.168.203.53@tcp:8:mount.lustre.0 Request processed in 357us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787577.602140:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 12 00000100:00100000:1.0:1785787577.602153:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 13 00000100:00100000:1.0:1785787577.602157:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2387:x1872533744791936:12345-192.168.203.53@tcp:8:mount.lustre.0 00010000:00080000:1.0:1785787577.602171:0:9394:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from f4ec65b7-e63e-42dc-becf-cba362002085@192.168.203.53@tcp t0 exp 0000000000000000 cur 364 last 0 00000020:00000080:1.0:1785787577.602187:0:9394:0:(genops.c:1406:class_connect()) connect: client f4ec65b7-e63e-42dc-becf-cba362002085, cookie 0xe2c2ff68a6e8453b 00002000:00100000:1.0:1785787577.602192:0:9394:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f4ec65b7-e63e-42dc-becf-cba362002085/ffff91907fe6c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113801 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1785787577.602206:0:9394:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1785787577.602340:0:9394:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1785787577.602354:0:9394:0:(import.c:65:import_set_state_nolock()) ffff91907fe6f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1785787577.602381:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4ec65b7-e63e-42dc-becf-cba362002085+6:2387:x1872533744791936:12345-192.168.203.53@tcp:8:mount.lustre.0 Request processed in 221us (1245us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787577.602388:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 13 00010000:00010000:3.0:1785787577.845134:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785787578.291087:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905069ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769994368:0@lo:400:kworker.0 00000100:00100000:1.0:1785787578.291157:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787578.291226:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785787578.291233:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905069f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3336:1872533769994240:0@lo:400:kworker.0 00000100:00100000:1.0:1785787578.291258:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787578.291288:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769994240 00000100:00100000:1.0:1785787578.291294:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769994240 00000100:00100000:1.0:1785787578.291341:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1785787578.291350:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3336:x1872533769994240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787578.291397:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3336:x1872533769994240:12345-0@lo:400:kworker.0 Request processed in 49us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787578.291404:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1785787578.291421:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785787578.291447:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905069f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3336:1872533769994240:0@lo:400:kworker.0 00000100:00100000:1.0:1785787578.291468:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769994368 00000100:00100000:1.0:1785787578.291471:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769994368 00000100:00100000:1.0:1785787578.291499:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1785787578.291505:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769994368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787578.291535:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769994368:12345-0@lo:400:kworker.0 Request processed in 30us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787578.291541:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1785787578.291555:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1785787578.291570:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91905069ca80 x1872533769994368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787578.291580:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905069ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769994368:0@lo:400:kworker.0 00000100:00100000:2.0:1785787578.291711:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905069df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533769994112:0@lo:400:kworker.0 00000100:00100000:2.0:1785787578.291738:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787578.291761:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905069f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533769994624:0@lo:400:kworker.0 00000100:00100000:2.0:1785787578.291777:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787578.291796:0:3334:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1785787578.291800:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905069e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533769993984:0@lo:400:kworker.0 00000100:00100000:2.0:1785787578.291819:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787578.291856:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905069dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3334:1872533769994496:0@lo:400:kworker.0 00000100:00100000:2.0:1785787578.291874:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787578.291958:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769994112 00000100:00100000:0.0:1785787578.291963:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769994112 00000100:00100000:0.0:1785787578.291995:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769994496 00000100:00100000:0.0:1785787578.291998:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769994496 00000100:00100000:0.0:1785787578.292020:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1785787578.292027:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ec9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533769994112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787578.292066:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ec9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533769994112:12345-0@lo:400:kworker.0 Request processed in 40us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787578.292072:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1785787578.292086:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1785787578.292092:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3334:x1872533769994496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787578.292118:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3334:x1872533769994496:12345-0@lo:400:kworker.0 Request processed in 27us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787578.292124:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1785787578.292153:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905069dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3334:1872533769994496:0@lo:400:kworker.0 00000100:00100000:0.0:1785787578.292161:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905069df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533769994112:0@lo:400:kworker.0 00000100:00100000:0.0:1785787578.292193:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769993984 00000100:00100000:0.0:1785787578.292196:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769993984 00000100:00100000:0.0:1785787578.292228:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1785787578.292234:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+19:3334:x1872533769993984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787578.292269:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+19:3334:x1872533769993984:12345-0@lo:400:kworker.0 Request processed in 34us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787578.292275:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1785787578.292302:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905069e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533769993984:0@lo:400:kworker.0 00000100:00100000:1.0:1785787578.293044:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769994624 00000100:00100000:1.0:1785787578.293056:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769994624 00000100:00100000:1.0:1785787578.293093:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1785787578.293101:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ec9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533769994624:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1785787578.293226:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785787578.293230:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785787578.293266:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ec9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533769994624:12345-0@lo:400:kworker.0 Request processed in 167us (1487us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787578.293273:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1785787578.299741:0:3334:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91905069f480 x1872533769994624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787578.299760:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905069f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533769994624:0@lo:400:kworker.0 00000100:00100000:2.0:1785787578.810171:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785787578.814151:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769994752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785787578.814235:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787578.826871:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769994752 00000100:00100000:1.0:1785787578.826894:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769994752 00000100:00100000:1.0:1785787578.826956:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1785787578.826966:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ecb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769994752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785787578.827005:0:6620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785787578.827087:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ecb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769994752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (12851us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787578.827095:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1785787578.827139:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919077a9f800 x1872533769994752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787594 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787578.827159:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769994752:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1785787578.868942:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1785787579.874374:0:6642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f4ec65b7-e63e-42dc-becf-cba362002085 00010000:00010000:1.0:1785787579.891847:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1785787580.382346:0:5843:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f4ec65b7-e63e-42dc-becf-cba362002085 00000100:00100000:2.0:1785787580.852869:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076ecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769994880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785787580.852942:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787580.853010:0:6621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769994880 00000100:00100000:2.0:1785787580.853017:0:6621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769994880 00000100:00100000:2.0:1785787580.853066:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1785787580.853075:0:6621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769994880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785787580.853105:0:6621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785787580.853148:0:6621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769994880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787580.853166:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1785787580.853217:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076ecb480 x1872533769994880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787596 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787580.853236:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076ecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769994880:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1785787580.858528:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1785787580.916111:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1785787580.960738:0:7522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f4ec65b7-e63e-42dc-becf-cba362002085 00010000:00010000:1.0:1785787581.939135:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787582.963018:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785787583.103221:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787583.103266:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787583.103304:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787583.103335:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787583.103365:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744792576 00000100:00100000:1.0:1785787583.103366:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787583.103378:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744792576 00000100:00100000:1.0:1785787583.103408:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744792704 00000100:00100000:1.0:1785787583.103417:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744792704 00000100:00100000:2.0:1785787583.103462:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 46 00000100:00100000:1.0:1785787583.103482:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 47 00000100:00100000:2.0:1785787583.103483:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4ec65b7-e63e-42dc-becf-cba362002085+5:2389:x1872533744792576:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1785787583.103513:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905069e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4ec65b7-e63e-42dc-becf-cba362002085+5:2389:x1872533744792704:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:2.0:1785787583.103562:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4ec65b7-e63e-42dc-becf-cba362002085+5:2389:x1872533744792576:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 88us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787583.103571:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 46 00000100:00100000:1.0:1785787583.103579:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905069e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4ec65b7-e63e-42dc-becf-cba362002085+5:2389:x1872533744792704:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 69us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787583.103590:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 47 00000100:00080000:2.0:1785787583.103602:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785787583.103610:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785787583.103718:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744792320 00000100:00100000:0.0:1785787583.103725:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744792320 00000100:00080000:2.0:1785787583.103782:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785787583.103791:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744792448 00000100:00100000:0.0:1785787583.103796:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744792448 00000100:00100000:2.0:1785787583.103824:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 84 00000100:00100000:2.0:1785787583.103872:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+6:2389:x1872533744792320:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1785787583.103882:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 85 00000100:00100000:0.0:1785787583.103894:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905069f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4ec65b7-e63e-42dc-becf-cba362002085+5:2389:x1872533744792448:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:2.0:1785787583.103919:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+6:2389:x1872533744792320:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 49us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787583.103929:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 84 00000100:00100000:0.0:1785787583.103941:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905069f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4ec65b7-e63e-42dc-becf-cba362002085+5:2389:x1872533744792448:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 48us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787583.103950:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 85 00000100:00080000:2.0:1785787583.103971:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785787583.104155:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744792192 00000100:00100000:3.0:1785787583.104161:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744792192 00000100:00100000:3.0:1785787583.104203:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 230 00000100:00100000:3.0:1785787583.104209:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2389:x1872533744792192:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1785787583.104236:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2389:x1872533744792192:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 28us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787583.104243:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 230 00000100:00100000:0.0:1785787583.411298:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905069df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533769995008:0@lo:400:kworker.0 00000100:00100000:0.0:1785787583.411393:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787583.411586:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769995008 00000100:00100000:2.0:1785787583.411600:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769995008 00000100:00100000:2.0:1785787583.411659:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1785787583.411683:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051504c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+19:3333:x1872533769995008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787583.411811:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905069dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533769995136:0@lo:400:kworker.0 00000100:00100000:3.0:1785787583.411880:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787583.411951:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769995136 00000100:00100000:3.0:1785787583.411958:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769995136 00000100:00100000:3.0:1785787583.412017:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1785787583.412026:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533769995136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787583.412074:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533769995136:12345-0@lo:400:kworker.0 Request processed in 48us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787583.412082:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1785787583.412122:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905069dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533769995136:0@lo:400:kworker.0 00000100:00100000:1.0:1785787583.432497:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533769995648:0@lo:400:kworker.0 00000100:00100000:1.0:1785787583.432582:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787583.432627:0:3334:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785787583.432633:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905069dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3334:1872533769995520:0@lo:400:kworker.0 00000100:00100000:1.0:1785787583.432655:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787583.432690:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769995520 00000100:00100000:1.0:1785787583.432699:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769995520 00000100:00100000:3.0:1785787583.434009:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905069f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769995392:0@lo:400:kworker.0 00000100:00100000:3.0:1785787583.434051:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787583.434094:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785787583.434100:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905069ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3336:1872533769995264:0@lo:400:kworker.0 00000100:00100000:3.0:1785787583.434121:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787583.434151:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769995264 00000100:00100000:3.0:1785787583.434155:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769995264 00000100:00100000:3.0:1785787583.434205:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1785787583.434214:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905267ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3334:x1872533769995520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787583.434271:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905267ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3334:x1872533769995520:12345-0@lo:400:kworker.0 Request processed in 58us (1614us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787583.434278:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1785787583.434296:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1785787583.434301:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3336:x1872533769995264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787583.434327:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3336:x1872533769995264:12345-0@lo:400:kworker.0 Request processed in 26us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787583.434333:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1785787583.434371:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905069ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3336:1872533769995264:0@lo:400:kworker.0 00000100:00100000:3.0:1785787583.434401:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905069dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3334:1872533769995520:0@lo:400:kworker.0 00000100:00100000:3.0:1785787583.434423:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769995648 00000100:00100000:3.0:1785787583.434426:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769995648 00000100:00100000:3.0:1785787583.434451:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769995392 00000100:00100000:3.0:1785787583.434453:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769995392 00000100:00100000:3.0:1785787583.434472:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1785787583.434477:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905267dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533769995648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787583.434508:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905267dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533769995648:12345-0@lo:400:kworker.0 Request processed in 31us (1927us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787583.434514:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1785787583.434534:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1785787583.434540:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769995392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787583.434576:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769995392:12345-0@lo:400:kworker.0 Request processed in 36us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787583.434582:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1785787583.434614:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91905069f800 x1872533769995392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787583.434629:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905069f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769995392:0@lo:400:kworker.0 00000100:00100000:2.0:1785787583.434637:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051504c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+19:3333:x1872533769995008:12345-0@lo:400:kworker.0 Request processed in 22942us (23230us total) trans 0 rc 0/0 00010000:00080000:3.0:1785787583.434657:0:3334:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91905267d180 x1872533769995648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787583.434658:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1785787583.434677:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533769995648:0@lo:400:kworker.0 00000100:00080000:2.0:1785787583.434769:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1785787583.434775:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785787583.434778:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785787583.442201:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905069df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533769995008:0@lo:400:kworker.0 00000100:00100000:1.0:1785787583.923083:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785787583.923115:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769995776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785787583.923214:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787583.923362:0:8140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769995776 00000100:00100000:0.0:1785787583.923372:0:8140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769995776 00000100:00100000:0.0:1785787583.923428:0:8140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1785787583.923438:0:8140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905267d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769995776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785787583.923483:0:8140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785787583.923536:0:8140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905267d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769995776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787583.923543:0:8140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1785787583.923586:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91905267c380 x1872533769995776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787599 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787583.923606:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769995776:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785787583.986972:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787585.012920:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1785787585.020466:0:10197:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg353-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:0.0:1785787585.971514:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785787585.971548:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769995904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785787585.971646:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787585.971720:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769995904 00000100:00100000:0.0:1785787585.971731:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769995904 00000100:00100000:0.0:1785787585.971795:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1785787585.971806:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077714000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769995904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785787585.971868:0:6620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785787585.972179:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077714000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769995904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 375us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787585.972188:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1785787585.972999:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1785787585.973151:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919077715500 x1872533769995904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787601 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787585.973186:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769995904:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1785787586.035127:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787587.062005:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787588.083281:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785787588.232567:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787588.232619:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787588.232642:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787588.232661:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787588.232681:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787588.233426:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744792832 00000100:00100000:0.0:1785787588.233436:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744792832 00000100:00100000:0.0:1785787588.233496:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 232 00000100:00100000:0.0:1785787588.233506:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051507050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2391:x1872533744792832:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1785787588.233587:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051507050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2391:x1872533744792832:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 83us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787588.233604:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 232 00000100:00100000:3.0:1785787588.236210:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744793088 00000100:00100000:3.0:1785787588.236223:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744793088 00000100:00100000:3.0:1785787588.236326:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744792960 00000100:00100000:3.0:1785787588.236330:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744792960 00000100:00100000:3.0:1785787588.236357:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 89 00000100:00100000:3.0:1785787588.236366:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ecb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4ec65b7-e63e-42dc-becf-cba362002085+5:2391:x1872533744793088:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1785787588.236444:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ecb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4ec65b7-e63e-42dc-becf-cba362002085+5:2391:x1872533744793088:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 78us (3824us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787588.236450:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 89 00000100:00100000:3.0:1785787588.236465:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 90 00000100:00100000:3.0:1785787588.236471:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+6:2391:x1872533744792960:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1785787588.236494:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+6:2391:x1872533744792960:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 24us (3833us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787588.236507:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 90 00000100:00100000:3.0:1785787588.236526:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744793344 00000100:00100000:3.0:1785787588.236530:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744793344 00000100:00100000:3.0:1785787588.236554:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744793216 00000100:00100000:3.0:1785787588.236557:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744793216 00000100:00100000:3.0:1785787588.236577:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 50 00000100:00100000:3.0:1785787588.236583:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ec8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4ec65b7-e63e-42dc-becf-cba362002085+5:2391:x1872533744793344:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1785787588.236621:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ec8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4ec65b7-e63e-42dc-becf-cba362002085+5:2391:x1872533744793344:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 38us (3978us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787588.236626:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 50 00000100:00100000:3.0:1785787588.236637:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 51 00000100:00100000:3.0:1785787588.236643:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4ec65b7-e63e-42dc-becf-cba362002085+5:2391:x1872533744793216:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1785787588.236661:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4ec65b7-e63e-42dc-becf-cba362002085+5:2391:x1872533744793216:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 19us (3980us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787588.236667:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 51 00000100:00080000:0.0:1785787588.238474:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785787588.238481:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785787588.238484:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785787588.531314:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fe15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533769996160:0@lo:400:kworker.0 00000100:00100000:2.0:1785787588.531387:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787588.531436:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fe17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533769996672:0@lo:400:kworker.0 00000100:00100000:2.0:1785787588.531457:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787588.531483:0:3334:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1785787588.531488:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fe16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533769996032:0@lo:400:kworker.0 00000100:00100000:2.0:1785787588.531512:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787588.531528:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fe14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3334:1872533769996544:0@lo:400:kworker.0 00000100:00100000:2.0:1785787588.531543:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787588.531563:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fe16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533769996288:0@lo:400:kworker.0 00000100:00100000:2.0:1785787588.531581:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787588.531597:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785787588.531609:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fe16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769996416:0@lo:400:kworker.0 00000100:00100000:2.0:1785787588.531629:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787588.531657:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769996160 00000100:00100000:2.0:1785787588.531663:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769996160 00000100:00100000:2.0:1785787588.531697:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769996544 00000100:00100000:2.0:1785787588.531699:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769996544 00000100:00100000:2.0:1785787588.531715:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769996288 00000100:00100000:2.0:1785787588.531718:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769996288 00000100:00100000:2.0:1785787588.531730:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1785787588.531736:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533769996160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787588.531778:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533769996160:12345-0@lo:400:kworker.0 Request processed in 41us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787588.531784:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1785787588.531800:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1785787588.531805:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3334:x1872533769996544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787588.531850:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3334:x1872533769996544:12345-0@lo:400:kworker.0 Request processed in 23us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787588.531855:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1785787588.531866:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1785787588.531871:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533769996288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787588.531896:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533769996288:12345-0@lo:400:kworker.0 Request processed in 26us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787588.531901:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1785787588.531916:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769996672 00000100:00100000:2.0:1785787588.531919:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769996672 00000100:00100000:2.0:1785787588.531938:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769996416 00000100:00100000:2.0:1785787588.531940:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769996416 00000100:00100000:2.0:1785787588.531954:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1785787588.531965:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533769996672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787588.531990:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533769996672:12345-0@lo:400:kworker.0 Request processed in 27us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787588.531995:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1785787588.532005:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1785787588.532009:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769996416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787588.532028:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769996416:12345-0@lo:400:kworker.0 Request processed in 19us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787588.532033:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1785787588.532046:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769996032 00000100:00100000:2.0:1785787588.532049:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769996032 00000100:00100000:2.0:1785787588.532068:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1785787588.532072:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051505c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+19:3334:x1872533769996032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787588.532095:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051505c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+19:3334:x1872533769996032:12345-0@lo:400:kworker.0 Request processed in 23us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787588.532099:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00080000:2.0:1785787588.532156:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1785787588.532160:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785787588.532162:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1785787588.532191:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907fe16d80 x1872533769996416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787588.532203:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fe16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769996416:0@lo:400:kworker.0 00000100:00100000:2.0:1785787588.532222:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fe16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533769996288:0@lo:400:kworker.0 00000100:00100000:2.0:1785787588.532245:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fe16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533769996032:0@lo:400:kworker.0 00000100:00100000:2.0:1785787588.532253:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fe14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3334:1872533769996544:0@lo:400:kworker.0 00000100:00100000:2.0:1785787588.532267:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fe15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533769996160:0@lo:400:kworker.0 00010000:00080000:2.0:1785787588.532275:0:3334:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907fe17480 x1872533769996672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787588.532282:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fe17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533769996672:0@lo:400:kworker.0 00000100:00100000:3.0:1785787589.050860:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785787589.050883:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769996800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785787589.050950:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787589.051010:0:6621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769996800 00000100:00100000:3.0:1785787589.051017:0:6621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769996800 00000100:00100000:3.0:1785787589.051063:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1785787589.051072:0:6621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ecd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769996800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785787589.051117:0:6621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785787589.051183:0:6621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ecd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769996800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787589.051206:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1785787589.051246:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91905267ce00 x1872533769996800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787605 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787589.051263:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769996800:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785787589.108848:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787590.134159:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787591.091592:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769996928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785787591.091661:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787591.091807:0:8140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769996928 00000100:00100000:0.0:1785787591.091816:0:8140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769996928 00000100:00100000:0.0:1785787591.091892:0:8140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1785787591.091902:0:8140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769996928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785787591.091933:0:8140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785787591.091977:0:8140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769996928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787591.091995:0:8140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1785787591.092016:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1785787591.092044:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919077715500 x1872533769996928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787607 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787591.092061:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769996928:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1785787591.155162:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787592.179064:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787593.205445:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785787593.344070:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787593.358524:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787593.358562:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787593.358587:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787593.358616:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787593.363964:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744793600 00000100:00100000:2.0:1785787593.363977:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744793600 00000100:00100000:2.0:1785787593.364001:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744793856 00000100:00100000:2.0:1785787593.364004:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744793856 00000100:00100000:2.0:1785787593.364932:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744793984 00000100:00100000:2.0:1785787593.364937:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744793984 00000100:00100000:0.0:1785787593.365907:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 54 00000100:00100000:0.0:1785787593.365927:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905267ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4ec65b7-e63e-42dc-becf-cba362002085+5:2388:x1872533744793856:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1785787593.366008:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905267ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4ec65b7-e63e-42dc-becf-cba362002085+5:2388:x1872533744793856:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 84us (7492us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787593.366016:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 54 00000100:00100000:0.0:1785787593.366041:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744793728 00000100:00100000:0.0:1785787593.366045:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744793728 00000100:00080000:1.0:1785787593.370012:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1785787593.370019:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785787593.370022:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785787593.370266:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 55 00000100:00100000:2.0:1785787593.370277:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905267d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4ec65b7-e63e-42dc-becf-cba362002085+5:2388:x1872533744793984:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:2.0:1785787593.370387:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905267d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4ec65b7-e63e-42dc-becf-cba362002085+5:2388:x1872533744793984:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 98us (11757us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787593.370395:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 55 00000100:00100000:1.0:1785787593.371935:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744793472 00000100:00100000:1.0:1785787593.371945:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744793472 00000100:00100000:1.0:1785787593.371983:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 234 00000100:00100000:1.0:1785787593.371991:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051505450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2388:x1872533744793472:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1785787593.372035:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051505450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2388:x1872533744793472:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 45us (13473us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787593.372042:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 234 00000100:00100000:0.0:1785787593.373343:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 94 00000100:00100000:0.0:1785787593.373354:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905267c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4ec65b7-e63e-42dc-becf-cba362002085+5:2388:x1872533744793728:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1785787593.373408:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905267c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4ec65b7-e63e-42dc-becf-cba362002085+5:2388:x1872533744793728:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 57us (14820us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787593.373416:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 94 00000100:00100000:3.0:1785787593.376415:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 95 00000100:00100000:3.0:1785787593.376427:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905267f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+6:2388:x1872533744793600:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1785787593.376487:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905267f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+6:2388:x1872533744793600:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 63us (32424us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787593.376493:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 95 00000100:00100000:0.0:1785787593.651301:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533769997184:0@lo:400:kworker.0 00000100:00100000:0.0:1785787593.651387:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787593.651432:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533769997696:0@lo:400:kworker.0 00000100:00100000:0.0:1785787593.651455:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787593.651480:0:3334:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1785787593.651485:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533769997056:0@lo:400:kworker.0 00000100:00100000:0.0:1785787593.651507:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787593.651525:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3334:1872533769997568:0@lo:400:kworker.0 00000100:00100000:0.0:1785787593.651543:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787593.654985:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769997184 00000100:00100000:1.0:1785787593.654997:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769997184 00000100:00100000:1.0:1785787593.655057:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769997568 00000100:00100000:1.0:1785787593.655060:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769997568 00000100:00100000:1.0:1785787593.655719:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1785787593.655730:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533769997184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787593.655801:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533769997184:12345-0@lo:400:kworker.0 Request processed in 73us (4414us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787593.655808:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1785787593.655823:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1785787593.655847:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3334:x1872533769997568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787593.655875:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3334:x1872533769997568:12345-0@lo:400:kworker.0 Request processed in 46us (4330us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787593.655880:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1785787593.656021:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077714700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769997440:0@lo:400:kworker.0 00000100:00100000:1.0:1785787593.656055:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787593.657988:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785787593.658003:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3336:1872533769997312:0@lo:400:kworker.0 00000100:00100000:1.0:1785787593.658047:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1785787593.658164:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785787593.658179:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769997312 00000100:00100000:1.0:1785787593.658185:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769997312 00000100:00100000:1.0:1785787593.658223:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1785787593.658230:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077089180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3336:x1872533769997312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787593.658284:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077089180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3336:x1872533769997312:12345-0@lo:400:kworker.0 Request processed in 54us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787593.658292:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:1.0:1785787593.658306:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785787593.658329:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3336:1872533769997312:0@lo:400:kworker.0 00000100:00100000:1.0:1785787593.658370:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769997056 00000100:00100000:1.0:1785787593.658374:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769997056 00000100:00100000:1.0:1785787593.658395:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1785787593.658401:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051507450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+19:3334:x1872533769997056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787593.658430:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051507450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+19:3334:x1872533769997056:12345-0@lo:400:kworker.0 Request processed in 29us (6921us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787593.658436:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1785787593.658458:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769997696 00000100:00100000:1.0:1785787593.658462:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769997696 00000100:00100000:1.0:1785787593.658487:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769997440 00000100:00100000:1.0:1785787593.658490:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769997440 00000100:00100000:1.0:1785787593.658506:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1785787593.658512:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533769997696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787593.658539:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533769997696:12345-0@lo:400:kworker.0 Request processed in 27us (7083us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787593.658544:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1785787593.658554:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1785787593.658559:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907708a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769997440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787593.658602:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907708a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769997440:12345-0@lo:400:kworker.0 Request processed in 42us (2546us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787593.658609:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1785787593.658636:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785787593.658639:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1785787593.658659:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919077714700 x1872533769997440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787593.658670:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077714700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769997440:0@lo:400:kworker.0 00000100:00100000:0.0:1785787593.668040:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533769997056:0@lo:400:kworker.0 00000100:00100000:0.0:1785787593.668061:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3334:1872533769997568:0@lo:400:kworker.0 00000100:00100000:0.0:1785787593.668072:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533769997184:0@lo:400:kworker.0 00010000:00080000:0.0:1785787593.668122:0:3334:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919077717b80 x1872533769997696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787593.668133:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533769997696:0@lo:400:kworker.0 00000100:00100000:0.0:1785787594.166119:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785787594.166140:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907708b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769997824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785787594.166201:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787594.166351:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769997824 00000100:00100000:1.0:1785787594.166359:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769997824 00000100:00100000:1.0:1785787594.166405:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1785787594.166413:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769997824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785787594.166444:0:6620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785787594.166487:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769997824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787594.166493:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1785787594.166527:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907708b480 x1872533769997824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787610 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787594.166599:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907708b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769997824:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1785787594.229245:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787595.261916:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785787596.224282:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785787596.224303:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907708b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769997952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785787596.224362:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787596.224417:0:6621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769997952 00000100:00100000:1.0:1785787596.224424:0:6621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769997952 00000100:00100000:1.0:1785787596.224465:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1785787596.224472:0:6621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907708aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769997952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785787596.224503:0:6621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785787596.224538:0:6621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907708aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769997952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787596.224554:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1785787596.224572:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1785787596.224599:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907708b480 x1872533769997952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787612 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787596.224614:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907708b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769997952:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1785787596.282155:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787597.302276:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787598.324392:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785787598.471478:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787598.471520:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787598.471543:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787598.471565:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787598.471602:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787598.471629:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744794496 00000100:00100000:1.0:1785787598.471638:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744794496 00000100:00100000:1.0:1785787598.471688:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744794624 00000100:00100000:1.0:1785787598.471691:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744794624 00000100:00100000:1.0:1785787598.471712:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 14 00000100:00100000:1.0:1785787598.471721:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077088e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4ec65b7-e63e-42dc-becf-cba362002085+5:2387:x1872533744794496:12345-192.168.203.53@tcp:9:kworker.0 00000020:00000080:1.0:1785787598.471749:0:6617:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2c2ff68a6e84534 00000100:00080000:1.0:1785787598.471757:0:6617:0:(import.c:65:import_set_state_nolock()) ffff91907fe68800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1785787598.471796:0:6617:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1785787598.472160:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077088e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4ec65b7-e63e-42dc-becf-cba362002085+2:2387:x1872533744794496:12345-192.168.203.53@tcp:9:kworker.0 Request processed in 439us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787598.472167:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 14 00000100:00100000:1.0:1785787598.472182:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 15 00000100:00100000:1.0:1785787598.472189:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4ec65b7-e63e-42dc-becf-cba362002085+5:2387:x1872533744794624:12345-192.168.203.53@tcp:9:kworker.0 00000020:00000080:1.0:1785787598.472217:0:6617:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2c2ff68a6e8453b 00000100:00080000:1.0:1785787598.472223:0:6617:0:(import.c:65:import_set_state_nolock()) ffff91907fe6f000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1785787598.472242:0:6617:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1785787598.472417:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4ec65b7-e63e-42dc-becf-cba362002085+2:2387:x1872533744794624:12345-192.168.203.53@tcp:9:kworker.0 Request processed in 228us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787598.472425:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 15 00000100:00080000:1.0:1785787598.472444:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785787598.472447:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1785787598.472459:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787598.472465:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785787598.472580:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744794112 00000100:00100000:2.0:1785787598.472584:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744794112 00000100:00100000:2.0:1785787598.472619:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 236 00000100:00100000:2.0:1785787598.472626:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051504850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2390:x1872533744794112:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:2.0:1785787598.472656:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051504850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2390:x1872533744794112:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 30us (1186us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787598.472663:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 236 00000100:00100000:0.0:1785787598.472757:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744794368 00000100:00100000:0.0:1785787598.472762:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744794368 00000100:00100000:0.0:1785787598.472791:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744794240 00000100:00100000:0.0:1785787598.472794:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744794240 00000100:00100000:0.0:1785787598.472811:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 99 00000100:00100000:0.0:1785787598.472817:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907708b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4ec65b7-e63e-42dc-becf-cba362002085+5:2390:x1872533744794368:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1785787598.472870:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907708b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4ec65b7-e63e-42dc-becf-cba362002085+5:2390:x1872533744794368:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 52us (1349us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787598.472877:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 99 00000100:00100000:0.0:1785787598.472889:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 100 00000100:00100000:0.0:1785787598.472895:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907708b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+6:2390:x1872533744794240:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1785787598.472916:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907708b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+6:2390:x1872533744794240:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 21us (1373us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787598.472923:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 100 00000100:00080000:1.0:1785787598.473477:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785787598.771027:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bb34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533769998336:0@lo:400:kworker.0 00000100:00100000:0.0:1785787598.771105:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787598.771165:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785787598.771171:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bb37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769998464:0@lo:400:kworker.0 00000100:00100000:0.0:1785787598.771204:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787598.771238:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769998336 00000100:00100000:0.0:1785787598.771244:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769998336 00000100:00100000:0.0:1785787598.771293:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1785787598.771302:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533769998336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787598.771350:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533769998336:12345-0@lo:400:kworker.0 Request processed in 49us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787598.771356:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1785787598.771377:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769998464 00000100:00100000:0.0:1785787598.771380:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769998464 00000100:00100000:0.0:1785787598.771405:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1785787598.771411:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769998464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787598.771442:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769998464:12345-0@lo:400:kworker.0 Request processed in 31us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787598.771448:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1785787598.771464:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785787598.771468:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1785787598.771497:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907bb37b80 x1872533769998464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787598.771509:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bb37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769998464:0@lo:400:kworker.0 00000100:00100000:0.0:1785787598.771518:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bb34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533769998336:0@lo:400:kworker.0 00000100:00100000:2.0:1785787598.771753:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bb37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533769998080:0@lo:400:kworker.0 00000100:00100000:2.0:1785787598.771785:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787598.771816:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bb36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3333:1872533769998592:0@lo:400:kworker.0 00000100:00100000:2.0:1785787598.771865:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787598.771889:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1785787598.771897:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bb36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1872533769998208:0@lo:400:kworker.0 00000100:00100000:2.0:1785787598.771919:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787598.771945:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bb34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533769998720:0@lo:400:kworker.0 00000100:00100000:3.0:1785787598.771962:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769998592 00000100:00100000:3.0:1785787598.771968:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769998592 00000100:00100000:2.0:1785787598.771969:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787598.771999:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769998208 00000100:00100000:3.0:1785787598.772003:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769998208 00000100:00100000:2.0:1785787598.772020:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1785787598.772027:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1785787598.772032:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1872533769998592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787598.772040:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1872533769998208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787598.772249:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1872533769998592:12345-0@lo:400:kworker.0 Request processed in 221us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787598.772256:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1785787598.772276:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769998720 00000100:00100000:2.0:1785787598.772280:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769998720 00000100:00100000:2.0:1785787598.772303:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1785787598.772309:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533769998720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787598.773360:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769998080 00000100:00100000:0.0:1785787598.773366:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769998080 00000100:00100000:0.0:1785787598.773398:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1785787598.773405:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051504450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+19:3333:x1872533769998080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787598.779448:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1872533769998208:12345-0@lo:400:kworker.0 Request processed in 7402us (7518us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787598.779463:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1785787598.784308:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051504450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+19:3333:x1872533769998080:12345-0@lo:400:kworker.0 Request processed in 10896us (12515us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787598.784329:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00080000:0.0:1785787598.784369:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785787598.784374:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785787598.790232:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533769998720:12345-0@lo:400:kworker.0 Request processed in 17912us (18252us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787598.790248:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1785787598.790331:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bb36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1872533769998208:0@lo:400:kworker.0 00010000:00080000:2.0:1785787598.790347:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907bb34000 x1872533769998720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787598.790359:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bb34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533769998720:0@lo:400:kworker.0 00000100:00100000:2.0:1785787598.790370:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bb37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533769998080:0@lo:400:kworker.0 00000100:00100000:2.0:1785787598.790380:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bb36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3333:1872533769998592:0@lo:400:kworker.0 00000100:00100000:0.0:1785787599.293054:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bb34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769998848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785787599.293132:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787599.293198:0:8140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769998848 00000100:00100000:0.0:1785787599.293205:0:8140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769998848 00000100:00100000:0.0:1785787599.293249:0:8140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1785787599.293257:0:8140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769998848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785787599.293290:0:8140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785787599.293330:0:8140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769998848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787599.293338:0:8140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1785787599.293377:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907bb34380 x1872533769998848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787615 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787599.293393:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bb34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769998848:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1785787599.347090:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1785787600.369271:0:6642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f4ec65b7-e63e-42dc-becf-cba362002085 00000020:00000080:1.0:1785787600.369281:0:6642:0:(genops.c:906:class_export_put()) final put ffff91905fadb800/f4ec65b7-e63e-42dc-becf-cba362002085 00000020:00000080:3.0:1785787600.369340:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff91905fadb800/f4ec65b7-e63e-42dc-becf-cba362002085 for lustre-OST0000 00000020:00000080:3.0:1785787600.369397:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91907fe68800 for lustre-OST0000 00010000:00010000:1.0:1785787600.371079:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787601.334909:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769998976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785787601.335039:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787601.339226:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769998976 00000100:00100000:1.0:1785787601.339238:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769998976 00000100:00100000:1.0:1785787601.339341:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1785787601.339350:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ecf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769998976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785787601.339381:0:6620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785787601.339445:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ecf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769998976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (4406us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787601.339452:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1785787601.341977:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919077714a80 x1872533769998976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787617 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787601.342001:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769998976:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1785787601.348754:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1785787601.368717:0:7522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f4ec65b7-e63e-42dc-becf-cba362002085 00000020:00000080:2.0:1785787601.368725:0:7522:0:(genops.c:906:class_export_put()) final put ffff91907fe6c800/f4ec65b7-e63e-42dc-becf-cba362002085 00000020:00000080:2.0:1785787601.368753:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff91907fe6c800/f4ec65b7-e63e-42dc-becf-cba362002085 for lustre-OST0001 00000020:00000080:2.0:1785787601.368791:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91907fe6f000 for lustre-OST0001 00010000:00010000:1.0:1785787601.395079:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787602.419750:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787603.450056:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787603.583227:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787603.583271:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787603.583300:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787603.583366:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744794880 00000100:00100000:3.0:1785787603.583375:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744794880 00000100:00100000:3.0:1785787603.583431:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744795008 00000100:00100000:3.0:1785787603.583434:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744795008 00000100:00100000:3.0:1785787603.583452:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 104 00000100:00100000:3.0:1785787603.583460:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+6:2390:x1872533744794880:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1785787603.583525:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+6:2390:x1872533744794880:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 65us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787603.583532:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 104 00000100:00100000:3.0:1785787603.583546:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 105 00000100:00100000:3.0:1785787603.583552:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4ec65b7-e63e-42dc-becf-cba362002085+5:2390:x1872533744795008:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1785787603.583571:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4ec65b7-e63e-42dc-becf-cba362002085+5:2390:x1872533744795008:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 20us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787603.583577:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 105 00000100:00100000:1.0:1785787603.584186:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744794752 00000100:00100000:1.0:1785787603.584192:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744794752 00000100:00100000:1.0:1785787603.584242:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 238 00000100:00100000:1.0:1785787603.584249:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051506050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2390:x1872533744794752:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1785787603.584284:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051506050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2390:x1872533744794752:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 36us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787603.584290:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 238 00000100:00080000:0.0:1785787603.584537:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785787603.891992:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785787603.892074:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076ecf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533769999232:0@lo:400:kworker.0 00000100:00100000:1.0:1785787603.892150:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787603.892165:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076eced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3336:1872533769999360:0@lo:400:kworker.0 00000100:00100000:3.0:1785787603.892192:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787603.892199:0:3334:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785787603.892205:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076ecdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533769999104:0@lo:400:kworker.0 00000100:00100000:3.0:1785787603.892228:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769999232 00000100:00100000:1.0:1785787603.892230:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787603.892234:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769999232 00000100:00100000:3.0:1785787603.892286:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769999360 00000100:00100000:3.0:1785787603.892290:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769999360 00000100:00100000:1.0:1785787603.892343:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1785787603.892352:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533769999232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787603.892403:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533769999232:12345-0@lo:400:kworker.0 Request processed in 52us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787603.892410:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1785787603.892446:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076ecf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533769999232:0@lo:400:kworker.0 00000100:00100000:3.0:1785787603.892523:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1785787603.892530:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3336:x1872533769999360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787603.892554:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769999104 00000100:00100000:0.0:1785787603.892558:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769999104 00000100:00100000:3.0:1785787603.892564:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3336:x1872533769999360:12345-0@lo:400:kworker.0 Request processed in 35us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787603.892570:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1785787603.892582:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1785787603.892587:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051506850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+19:3334:x1872533769999104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787603.892597:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076eced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3336:1872533769999360:0@lo:400:kworker.0 00000100:00100000:0.0:1785787603.892620:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051506850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+19:3334:x1872533769999104:12345-0@lo:400:kworker.0 Request processed in 33us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787603.892623:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076eced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769999488:0@lo:400:kworker.0 00000100:00100000:0.0:1785787603.892634:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1785787603.892645:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787603.892681:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769999488 00000100:00100000:0.0:1785787603.892685:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769999488 00000100:00100000:0.0:1785787603.892712:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1785787603.892719:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ece300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769999488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787603.892756:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ece300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533769999488:12345-0@lo:400:kworker.0 Request processed in 38us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787603.892762:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1785787603.892807:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bb34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3333:1872533769999616:0@lo:400:kworker.0 00000100:00100000:0.0:1785787603.892847:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787603.892883:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00080000:3.0:1785787603.892886:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076eced80 x1872533769999488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787603.892889:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bb37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533769999744:0@lo:400:kworker.0 00000100:00100000:0.0:1785787603.892911:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787603.892935:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769999744 00000100:00100000:0.0:1785787603.892938:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769999744 00000100:00100000:0.0:1785787603.892964:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1785787603.892970:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533769999744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787603.893002:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533769999744:12345-0@lo:400:kworker.0 Request processed in 33us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787603.893008:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:0.0:1785787603.893041:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907bb37100 x1872533769999744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787603.893051:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bb37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533769999744:0@lo:400:kworker.0 00000100:00100000:3.0:1785787603.893150:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076eced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533769999488:0@lo:400:kworker.0 00000100:00080000:1.0:1785787603.893885:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785787603.893890:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785787603.893893:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785787603.893902:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769999616 00000100:00100000:1.0:1785787603.893906:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769999616 00000100:00100000:1.0:1785787603.893940:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1785787603.893946:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1872533769999616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787603.893988:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1872533769999616:12345-0@lo:400:kworker.0 Request processed in 41us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787603.893994:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1785787603.894018:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785787603.894046:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bb34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3333:1872533769999616:0@lo:400:kworker.0 00000100:00100000:1.0:1785787603.894069:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076ecdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533769999104:0@lo:400:kworker.0 00000100:00100000:2.0:1785787604.403984:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bb37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769999872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785787604.404176:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787604.404869:0:6621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533769999872 00000100:00100000:0.0:1785787604.404878:0:6621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533769999872 00000100:00100000:0.0:1785787604.404927:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1785787604.404935:0:6621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769999872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785787604.404968:0:6621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785787604.405015:0:6621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533769999872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787604.405037:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1785787604.405310:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907bb37100 x1872533769999872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787620 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787604.405330:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bb37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533769999872:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1785787604.476959:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787605.492249:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785787606.454254:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770000000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785787606.454314:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787606.454381:0:8140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770000000 00000100:00100000:1.0:1785787606.454388:0:8140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770000000 00000100:00100000:1.0:1785787606.454437:0:8140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1785787606.454445:0:8140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077714700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770000000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785787606.454474:0:8140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785787606.454515:0:8140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077714700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770000000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787606.454522:0:8140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1785787606.454541:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1785787606.454569:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919077715500 x1872533770000000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787622 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787606.454586:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770000000:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1785787606.511524:0:10900:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1785787606.516630:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787607.542690:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787608.567442:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787608.711030:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787608.711066:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787608.711088:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787608.711112:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744795264 00000100:00100000:0.0:1785787608.711120:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744795264 00000100:00100000:0.0:1785787608.711169:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744795392 00000100:00100000:0.0:1785787608.711173:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744795392 00000100:00100000:0.0:1785787608.711193:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 109 00000100:00100000:0.0:1785787608.711202:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+6:2391:x1872533744795264:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1785787608.711285:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+6:2391:x1872533744795264:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 83us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787608.711292:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 109 00000100:00100000:0.0:1785787608.711307:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 110 00000100:00100000:0.0:1785787608.711313:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4ec65b7-e63e-42dc-becf-cba362002085+5:2391:x1872533744795392:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1785787608.711334:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4ec65b7-e63e-42dc-becf-cba362002085+5:2391:x1872533744795392:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 22us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787608.711339:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 110 00000100:00100000:0.0:1785787608.711355:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744795136 00000100:00100000:0.0:1785787608.711357:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744795136 00000100:00100000:0.0:1785787608.711378:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 240 00000100:00100000:0.0:1785787608.711384:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051507850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2391:x1872533744795136:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1785787608.711420:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051507850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2391:x1872533744795136:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 36us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787608.711427:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 240 00000100:00080000:0.0:1785787608.711454:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785787609.011134:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533770000384:0@lo:400:kworker.0 00000100:00100000:1.0:1785787609.011202:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787609.011263:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785787609.011270:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770000512:0@lo:400:kworker.0 00000100:00100000:1.0:1785787609.011297:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787609.011351:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770000384 00000100:00100000:1.0:1785787609.011357:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770000384 00000100:00100000:1.0:1785787609.011410:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1785787609.011420:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533770000384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787609.011469:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533770000384:12345-0@lo:400:kworker.0 Request processed in 50us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787609.011477:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1785787609.011498:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770000512 00000100:00100000:1.0:1785787609.011501:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770000512 00000100:00100000:1.0:1785787609.011526:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1785787609.011532:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533770000512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787609.011561:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533770000512:12345-0@lo:400:kworker.0 Request processed in 29us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787609.011567:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1785787609.011582:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785787609.011586:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1785787609.011617:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9190514f6d80 x1872533770000512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787609.011631:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770000512:0@lo:400:kworker.0 00000100:00100000:1.0:1785787609.011642:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533770000384:0@lo:400:kworker.0 00000100:00100000:3.0:1785787609.011714:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533770000256:0@lo:400:kworker.0 00000100:00100000:3.0:1785787609.011743:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787609.011768:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770000768:0@lo:400:kworker.0 00000100:00100000:3.0:1785787609.011789:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787609.011813:0:3334:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1785787609.011819:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533770000128:0@lo:400:kworker.0 00000100:00100000:3.0:1785787609.011879:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787609.011909:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3334:1872533770000640:0@lo:400:kworker.0 00000100:00100000:3.0:1785787609.011932:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787609.011957:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770000768 00000100:00100000:3.0:1785787609.011961:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770000768 00000100:00100000:3.0:1785787609.011999:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1785787609.012007:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770000768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787609.012042:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770000768:12345-0@lo:400:kworker.0 Request processed in 36us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787609.012048:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1785787609.012066:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770000128 00000100:00100000:3.0:1785787609.012069:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770000128 00000100:00100000:3.0:1785787609.012093:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1785787609.012099:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051505050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+19:3334:x1872533770000128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787609.012127:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051505050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+19:3334:x1872533770000128:12345-0@lo:400:kworker.0 Request processed in 28us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787609.012132:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1785787609.012156:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770000256 00000100:00100000:3.0:1785787609.012160:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770000256 00000100:00100000:3.0:1785787609.012176:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770000640 00000100:00100000:3.0:1785787609.012179:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770000640 00000100:00100000:3.0:1785787609.012196:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1785787609.012202:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533770000256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787609.012232:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533770000256:12345-0@lo:400:kworker.0 Request processed in 29us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787609.012237:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1785787609.012249:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1785787609.012254:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ecf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3334:x1872533770000640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787609.012291:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ecf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3334:x1872533770000640:12345-0@lo:400:kworker.0 Request processed in 37us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787609.012298:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1785787609.012329:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533770000128:0@lo:400:kworker.0 00000100:00100000:3.0:1785787609.012339:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3334:1872533770000640:0@lo:400:kworker.0 00000100:00100000:3.0:1785787609.012347:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533770000256:0@lo:400:kworker.0 00010000:00080000:3.0:1785787609.012356:0:3334:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9190514f7800 x1872533770000768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787609.012364:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770000768:0@lo:400:kworker.0 00000100:00080000:1.0:1785787609.012536:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1785787609.012539:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785787609.522943:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785787609.522970:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905069df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770000896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785787609.523161:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787609.523232:0:6621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770000896 00000100:00100000:1.0:1785787609.523249:0:6621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770000896 00000100:00100000:1.0:1785787609.523301:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1785787609.523309:0:6621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905069f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770000896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785787609.523342:0:6621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785787609.523402:0:6621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905069f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770000896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787609.523409:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:3.0:1785787609.523909:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91905069df80 x1872533770000896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787625 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787609.523927:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905069df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770000896:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785787609.587344:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787610.614329:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1785787610.972725:0:11048:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffff32cda70 20000000:00000080:1.0:1785787610.972740:0:11048:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91905faf1400 uarg=0000000000000000 20000000:01000000:1.0:1785787610.972845:0:11048:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1785787610.972851:0:11048:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1785787610.972855:0:11048:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1785787610.977324:0:11049:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1785787610.978008:0:11048:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1785787610.998856:0:11048:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1785787610.998925:0:11048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff919050678800/0xe2c2ff68a6e84542 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787610.998945:0:11048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9190413a1200/0xe2c2ff68a6e844e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd259 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787610.998955:0:11048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91905f903c00/0xe2c2ff68a6e844f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e844ee expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787610.998962:0:11048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91905f903a00/0xe2c2ff68a6e84503 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e844fc expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787610.998970:0:11048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919043c0e800/0xe2c2ff68a6e84511 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e8450a expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787610.998988:0:11048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919050678c00/0xe2c2ff68a6e84526 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd291 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787610.998996:0:11048:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff919050678800/0xe2c2ff68a6e84542 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787610.999035:0:11048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919050678c00/0xe2c2ff68a6e84526 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd291 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787610.999063:0:11048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff919050678c00/0xe2c2ff68a6e84526 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd291 expref: 12 pid: 5813 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787610.999080:0:11048:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bb34e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11048:1872533770001024:192.168.203.53@tcp:104: 00010000:00010000:0.0:1785787610.999198:0:11048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919043c0e800/0xe2c2ff68a6e84511 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2c2ff68a6e8450a expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787610.999209:0:11048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919043c0e800/0xe2c2ff68a6e84511 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2c2ff68a6e8450a expref: 18 pid: 5813 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787610.999220:0:11048:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bb36a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11048:1872533770001152:0@lo:104: 00000100:00100000:0.0:1785787610.999277:0:11048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1785787610.999327:0:11048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91905f903a00/0xe2c2ff68a6e84503 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2c2ff68a6e844fc expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787610.999339:0:11048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91905f903a00/0xe2c2ff68a6e84503 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2c2ff68a6e844fc expref: 18 pid: 5813 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787610.999348:0:11048:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bb34000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11048:1872533770001280:0@lo:104: 00000100:00100000:3.0:1785787610.999479:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770001152 00000100:00100000:3.0:1785787610.999488:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770001152 00000100:00100000:3.0:1785787610.999540:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1785787610.999549:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8642023-9103-4dbf-85d1-f204189bc871+3:11048:x1872533770001152:12345-0@lo:104: 00010000:00010000:3.0:1785787610.999562:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e8450a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e84511 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787610.999609:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1785787610.999620:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8642023-9103-4dbf-85d1-f204189bc871+3:11048:x1872533770001152:12345-0@lo:104: Request processed in 72us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787610.999627:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:3.0:1785787610.999646:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785787610.999651:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e8450a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e84511 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787610.999659:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903800 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:3.0:1785787610.999663:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e8450a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2c2ff68a6e84511 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787610.999671:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e8450a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2c2ff68a6e84511 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785787610.999678:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e8450a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2c2ff68a6e84511 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785787610.999684:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1785787610.999707:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e8450a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e84511 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787610.999713:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785787610.999729:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e8450a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e84511 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787610.999735:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e8450a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e84511 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787610.999746:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787610.999747:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787610.999749:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787610.999764:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905069df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8642023-9103-4dbf-85d1-f204189bc871:3336:1872533770001408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785787610.999792:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787611.000344:0:11048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1785787611.000389:0:11048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91905f903c00/0xe2c2ff68a6e844f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2c2ff68a6e844ee expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787611.000399:0:11048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91905f903c00/0xe2c2ff68a6e844f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2c2ff68a6e844ee expref: 18 pid: 5814 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787611.000409:0:11048:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fe16d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11048:1872533770001536:0@lo:104: 00000100:00100000:2.0:1785787611.000430:0:11048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1785787611.000446:0:11048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9190413a1200/0xe2c2ff68a6e844e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd259 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787611.000454:0:11048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9190413a1200/0xe2c2ff68a6e844e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd259 expref: 12 pid: 5813 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787611.000463:0:11048:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11048:1872533770001664:192.168.203.53@tcp:104: 00000100:00100000:2.0:1785787611.000502:0:11048:0:(client.c:2702:ptlrpc_set_wait()) set ffff91907fdffd80 going to sleep for 11 seconds 00000100:00100000:2.0:1785787611.000521:0:11048:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bb36a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11048:1872533770001152:0@lo:104: 00000100:00100000:3.0:1785787611.000580:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770001280 00000100:00100000:3.0:1785787611.000585:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770001280 00000100:00100000:3.0:1785787611.000602:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770001536 00000100:00100000:3.0:1785787611.000604:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770001536 00000100:00100000:3.0:1785787611.000615:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1785787611.000620:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8642023-9103-4dbf-85d1-f204189bc871+4:11048:x1872533770001280:12345-0@lo:104: 00010000:00010000:3.0:1785787611.000628:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff919043c0fa00/0xe2c2ff68a6e844fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e84503 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787611.000670:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1785787611.000675:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8642023-9103-4dbf-85d1-f204189bc871+4:11048:x1872533770001280:12345-0@lo:104: Request processed in 56us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787611.000682:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1785787611.000693:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1785787611.000698:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8642023-9103-4dbf-85d1-f204189bc871+3:11048:x1872533770001536:12345-0@lo:104: 00010000:00010000:3.0:1785787611.000705:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff91905f902800/0xe2c2ff68a6e844ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e844f5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787611.000730:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1785787611.000735:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8642023-9103-4dbf-85d1-f204189bc871+3:11048:x1872533770001536:12345-0@lo:104: Request processed in 38us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787611.000740:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1785787611.000751:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1785787611.000756:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff919043c0fa00/0xe2c2ff68a6e844fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e84503 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787611.000762:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0fa00 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:3.0:1785787611.000773:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff919043c0fa00/0xe2c2ff68a6e844fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2c2ff68a6e84503 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787611.000790:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff919043c0fa00/0xe2c2ff68a6e844fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2c2ff68a6e84503 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785787611.000797:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff919043c0fa00/0xe2c2ff68a6e844fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2c2ff68a6e84503 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785787611.000802:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1785787611.000821:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff919043c0fa00/0xe2c2ff68a6e844fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e84503 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787611.000842:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785787611.000856:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff919043c0fa00/0xe2c2ff68a6e844fc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e84503 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787611.000862:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff919043c0fa00/0xe2c2ff68a6e844fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e84503 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787611.001033:0:11048:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bb34000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11048:1872533770001280:0@lo:104: 00000100:00100000:2.0:1785787611.001225:0:11048:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fe16d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11048:1872533770001536:0@lo:104: 00010000:00010000:2.0:1785787611.001254:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1785787611.001280:0:3334:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785787611.001290:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905069dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533770001792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785787611.001316:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1785787611.001445:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787611.001447:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787611.001449:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785787611.001579:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770001408 00000100:00100000:1.0:1785787611.001584:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770001408 00010000:00010000:1.0:1785787611.001602:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919043c0e800/0xe2c2ff68a6e84511 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e8450a expref: 19 pid: 5813 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787611.001630:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770001792 00000100:00100000:1.0:1785787611.001632:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770001792 00010000:00010000:1.0:1785787611.001642:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91905f903a00/0xe2c2ff68a6e84503 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e844fc expref: 20 pid: 5813 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787611.001652:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1785787611.001657:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051464850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8642023-9103-4dbf-85d1-f204189bc871+20:3336:x1872533770001408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785787611.001666:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785787611.001671:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919043c0e800/0xe2c2ff68a6e84511 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e8450a expref: 20 pid: 5813 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787611.001680:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919043c0e800/0xe2c2ff68a6e84511 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2c2ff68a6e8450a expref: 20 pid: 5813 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787611.001692:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919043c0e800/0xe2c2ff68a6e84511 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2c2ff68a6e8450a expref: 20 pid: 5813 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787611.001713:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785787611.001744:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051464850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8642023-9103-4dbf-85d1-f204189bc871+19:3336:x1872533770001408:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (1951us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787611.001751:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1785787611.001783:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1785787611.001788:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8642023-9103-4dbf-85d1-f204189bc871+18:3334:x1872533770001792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785787611.001794:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785787611.001798:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91905f903a00/0xe2c2ff68a6e84503 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e844fc expref: 18 pid: 5813 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787611.001806:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91905f903a00/0xe2c2ff68a6e84503 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2c2ff68a6e844fc expref: 18 pid: 5813 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787611.001814:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91905f903a00/0xe2c2ff68a6e84503 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2c2ff68a6e844fc expref: 18 pid: 5813 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787611.001822:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785787611.001865:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8642023-9103-4dbf-85d1-f204189bc871+17:3334:x1872533770001792:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787611.001871:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1785787611.001895:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905069df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8642023-9103-4dbf-85d1-f204189bc871:3336:1872533770001408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785787611.001918:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905069dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533770001792:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785787611.009705:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787611.009712:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787611.009714:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787611.010037:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff91905f902800/0xe2c2ff68a6e844ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e844f5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787611.010052:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f902800 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:2.0:1785787611.010057:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff91905f902800/0xe2c2ff68a6e844ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2c2ff68a6e844f5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787611.010066:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff91905f902800/0xe2c2ff68a6e844ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2c2ff68a6e844f5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785787611.010074:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff91905f902800/0xe2c2ff68a6e844ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2c2ff68a6e844f5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785787611.010081:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1785787611.010132:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff91905f902800/0xe2c2ff68a6e844ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e844f5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787611.010138:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785787611.010173:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff91905f902800/0xe2c2ff68a6e844ee lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e844f5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787611.010180:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff91905f902800/0xe2c2ff68a6e844ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e844f5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787611.010197:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787611.010210:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787611.010212:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787611.010264:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785787611.010283:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533770001920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785787611.010349:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787611.010524:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770001920 00000100:00100000:2.0:1785787611.010531:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770001920 00010000:00010000:2.0:1785787611.010556:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91905f903c00/0xe2c2ff68a6e844f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e844ee expref: 17 pid: 5814 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787611.010591:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1785787611.010600:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905069ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8642023-9103-4dbf-85d1-f204189bc871+17:3333:x1872533770001920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785787611.010611:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785787611.010617:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91905f903c00/0xe2c2ff68a6e844f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e844ee expref: 17 pid: 5814 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787611.010629:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91905f903c00/0xe2c2ff68a6e844f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2c2ff68a6e844ee expref: 17 pid: 5814 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787611.010643:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91905f903c00/0xe2c2ff68a6e844f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2c2ff68a6e844ee expref: 17 pid: 5814 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787611.010656:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785787611.010695:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905069ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8642023-9103-4dbf-85d1-f204189bc871+16:3333:x1872533770001920:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787611.010702:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1785787611.010808:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533770001920:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785787611.017520:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787611.017579:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787611.017685:0:11048:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bb34e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11048:1872533770001024:192.168.203.53@tcp:104: 00000100:00100000:2.0:1785787611.017699:0:11048:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11048:1872533770001664:192.168.203.53@tcp:104: 00010000:00010000:2.0:1785787611.017730:0:11048:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff919050678800/0xe2c2ff68a6e84542 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787611.017795:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744795520 00000100:00100000:3.0:1785787611.017802:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744795520 00010000:00010000:3.0:1785787611.017859:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919050678c00/0xe2c2ff68a6e84526 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd291 expref: 13 pid: 5813 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787611.017888:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744795648 00000100:00100000:3.0:1785787611.017892:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744795648 00010000:00010000:3.0:1785787611.017903:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9190413a1200/0xe2c2ff68a6e844e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd259 expref: 14 pid: 5813 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787611.017919:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 28 00000100:00100000:3.0:1785787611.017926:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+14:2391:x1872533744795520:12345-192.168.203.53@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1785787611.018037:0:5807:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1785787611.018046:0:5807:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1785787611.018171:0:5805:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1785787611.018186:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 29 00000100:00100000:2.0:1785787611.018193:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+14:2391:x1872533744795648:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785787611.018205:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785787611.018211:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9190413a1200/0xe2c2ff68a6e844e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd259 expref: 14 pid: 5813 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787611.018221:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9190413a1200/0xe2c2ff68a6e844e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd259 expref: 14 pid: 5813 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787611.018236:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9190413a1200/0xe2c2ff68a6e844e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd259 expref: 14 pid: 5813 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787611.018249:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785787611.018309:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2391:x1872533744795648:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 115us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787611.018316:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 29 00010000:00010000:3.0:1785787611.018669:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787611.018675:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919050678c00/0xe2c2ff68a6e84526 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd291 expref: 12 pid: 5813 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787611.018685:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919050678c00/0xe2c2ff68a6e84526 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd291 expref: 12 pid: 5813 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787611.018696:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919050678c00/0xe2c2ff68a6e84526 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd291 expref: 12 pid: 5813 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787611.018707:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff919050678800/0xe2c2ff68a6e84542 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787611.018716:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919050678800/0xe2c2ff68a6e84542 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787611.018728:0:5806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919050678800/0xe2c2ff68a6e84542 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787611.018745:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919050678800/0xe2c2ff68a6e84542 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787611.018751:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff919050678800/0xe2c2ff68a6e84542 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787611.018757:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff919050678800/0xe2c2ff68a6e84542 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787611.018763:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919050678800 already unused, calling callback (ffffffffc174c300) 00010000:00010000:3.0:1785787611.018767:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff919050678800/0xe2c2ff68a6e84542 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787611.018775:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff919050678800/0xe2c2ff68a6e84542 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787611.018796:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff919050678800/0xe2c2ff68a6e84542 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787611.018806:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787611.018863:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+11:2391:x1872533744795520:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 901us (1314us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787611.018871:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 28 00010000:00010000:2.0:1785787611.018968:0:11048:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff919050678800/0xe2c2ff68a6e84542 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787611.018975:0:11048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff919050678800/0xe2c2ff68a6e84542 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787611.019040:0:11048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919050678800/0xe2c2ff68a6e84542 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787611.571425:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770002048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785787611.571490:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787611.573251:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770002048 00000100:00100000:2.0:1785787611.573263:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770002048 00000100:00100000:2.0:1785787611.573331:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1785787611.573340:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533770002048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785787611.573384:0:6620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785787611.573441:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533770002048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (1950us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787611.573448:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1785787611.573488:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919077a9bb80 x1872533770002048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787627 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787611.573506:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770002048:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1785787611.573626:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1785787611.635661:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785787612.222246:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787612.222362:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744795776 00000100:00100000:0.0:1785787612.222375:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744795776 00000100:00100000:0.0:1785787612.222444:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 242 00000100:00100000:0.0:1785787612.222455:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051504050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+11:5611:x1872533744795776:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785787612.222475:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787612.222515:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919050678a00/0xe2c2ff68a6e84549 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd2bb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787612.222548:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919050678a00/0xe2c2ff68a6e84549 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd2bb expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787612.222560:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919050678a00/0xe2c2ff68a6e84549 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd2bb expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787612.222572:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919050678a00, rc 0) 00000100:00100000:0.0:1785787612.222646:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051504050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+12:5611:x1872533744795776:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 Request processed in 193us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787612.222653:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 242 00000100:00100000:1.0:1785787612.228046:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787612.228160:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744795904 00000100:00100000:3.0:1785787612.228182:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744795904 00000100:00100000:3.0:1785787612.228254:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 243 00000100:00100000:3.0:1785787612.228264:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051507c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+12:5611:x1872533744795904:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785787612.228615:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051507c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+12:5611:x1872533744795904:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 Request processed in 350us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787612.228633:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 243 00000100:00100000:1.0:1785787612.230574:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787612.230649:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744796032 00000100:00100000:3.0:1785787612.230656:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744796032 00000100:00100000:3.0:1785787612.230701:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 244 00000100:00100000:3.0:1785787612.230715:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051506c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+12:5611:x1872533744796032:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785787612.231102:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051506c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+12:5611:x1872533744796032:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 Request processed in 393us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787612.231110:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 244 00000100:00100000:3.0:1785787612.246442:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787612.249079:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744796160 00000100:00100000:1.0:1785787612.249092:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744796160 00000100:00100000:1.0:1785787612.249159:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 245 00000100:00100000:1.0:1785787612.249169:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051505850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+12:5611:x1872533744796160:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1785787612.249186:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787612.249203:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919043c0ea00/0xe2c2ff68a6e84550 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd2c2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787612.249230:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919043c0ea00/0xe2c2ff68a6e84550 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd2c2 expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787612.249241:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919043c0ea00/0xe2c2ff68a6e84550 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd2c2 expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787612.249250:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919043c0ea00, rc 0) 00000100:00100000:1.0:1785787612.249310:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051505850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:5611:x1872533744796160:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 Request processed in 143us (2883us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787612.249317:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 245 00000100:00100000:1.0:1785787612.256798:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787612.257008:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744796288 00000100:00100000:3.0:1785787612.257021:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744796288 00000100:00100000:3.0:1785787612.257094:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 246 00000100:00100000:3.0:1785787612.257105:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051506450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:5611:x1872533744796288:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785787612.257450:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051506450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:5611:x1872533744796288:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 Request processed in 347us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787612.257459:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 246 00000100:00100000:3.0:1785787612.261039:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787612.261211:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744796416 00000100:00100000:1.0:1785787612.261223:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744796416 00000100:00100000:1.0:1785787612.261290:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 247 00000100:00100000:1.0:1785787612.261303:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:5611:x1872533744796416:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785787612.261677:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:5611:x1872533744796416:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 Request processed in 377us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787612.261696:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 247 10000000:01000000:1.0:1785787612.531194:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1785787612.531205:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff91907fddf800 from 7 10000000:01000000:1.0:1785787612.531211:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1785787612.531264:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff919043c0fe00/0xe2c2ff68a6e84557 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787612.531277:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff919043c0fe00/0xe2c2ff68a6e84557 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787612.531290:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff919043c0fe00/0xe2c2ff68a6e84557 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787612.531319:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533770002176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1785787612.531397:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787612.531448:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff91906ef69cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1785787612.533308:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770002176 00000100:00100000:3.0:1785787612.533321:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770002176 00000100:00100000:3.0:1785787612.533391:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1785787612.533400:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+16:5818:x1872533770002176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785787612.533418:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787612.533436:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91905f902c00/0xe2c2ff68a6e8455e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e84557 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787612.533485:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91905f902c00/0xe2c2ff68a6e8455e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e84557 expref: 17 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787612.533496:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91905f902c00/0xe2c2ff68a6e8455e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e84557 expref: 17 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787612.533507:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f902c00, rc 0) 00000100:00100000:3.0:1785787612.533573:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+17:5818:x1872533770002176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (2175us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787612.533580:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1785787612.535824:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533770002176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785787612.535875:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff919043c0fe00/0xe2c2ff68a6e84557 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e8455e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787612.535890:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff919043c0fe00/0xe2c2ff68a6e84557 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e8455e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787612.535998:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b48e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533770002304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785787612.536056:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787612.536102:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff91907fdffcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1785787612.538483:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770002304 00000100:00100000:3.0:1785787612.538499:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770002304 00000100:00100000:3.0:1785787612.538584:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1785787612.538595:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+17:5818:x1872533770002304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785787612.539630:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+17:5818:x1872533770002304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1036us (3572us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787612.539640:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1785787612.539748:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b48e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533770002304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785787612.539807:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533770002432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785787612.539884:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787612.539936:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff91906ef690c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785787612.540379:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770002432 00000100:00100000:3.0:1785787612.540385:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770002432 00000100:00100000:3.0:1785787612.540411:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1785787612.540419:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+17:5818:x1872533770002432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785787612.540581:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+17:5818:x1872533770002432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787612.540588:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1785787612.542855:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533770002432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1785787612.553466:0:11070:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1785787612.553694:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1785787612.553720:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1785787612.553749:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff919043c0fe00/0xe2c2ff68a6e84557 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e8455e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787612.553763:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff919043c0fe00/0xe2c2ff68a6e84557 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e8455e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785787612.553774:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1785787612.553777:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff919048214000 from 7 10000000:01000000:3.0:1785787612.553779:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1785787612.553858:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff91905f903600/0xe2c2ff68a6e84565 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787612.553867:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff91905f903600/0xe2c2ff68a6e84565 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787612.553881:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff91905f903600/0xe2c2ff68a6e84565 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787612.553912:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905069dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533770002560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1785787612.554011:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787612.554057:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905064ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1785787612.554133:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770002560 00000100:00100000:0.0:1785787612.554141:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770002560 00000100:00100000:0.0:1785787612.554192:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1785787612.554202:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+17:5818:x1872533770002560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785787612.554217:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787612.554236:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919050679200/0xe2c2ff68a6e8456c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e84565 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787612.554262:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919050679200/0xe2c2ff68a6e8456c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e84565 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787612.554275:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919050679200/0xe2c2ff68a6e8456c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e84565 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787612.554284:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919050679200, rc 0) 00000100:00100000:0.0:1785787612.554334:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+18:5818:x1872533770002560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787612.554341:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1785787612.554446:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905069dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533770002560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1785787612.554462:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff91905f903600/0xe2c2ff68a6e84565 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e8456c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787612.554471:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff91905f903600/0xe2c2ff68a6e84565 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e8456c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787612.554530:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533770002688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785787612.554559:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787612.554589:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff91906ef690c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785787612.554903:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770002688 00000100:00100000:0.0:1785787612.554908:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770002688 00000100:00100000:0.0:1785787612.554935:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1785787612.554942:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+18:5818:x1872533770002688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785787612.555237:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+18:5818:x1872533770002688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 295us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787612.555244:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1785787612.555534:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533770002688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785787612.555565:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533770002816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785787612.555606:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787612.555634:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff91906ef690c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785787612.555680:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770002816 00000100:00100000:0.0:1785787612.555684:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770002816 00000100:00100000:0.0:1785787612.555712:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1785787612.555719:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+18:5818:x1872533770002816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785787612.555899:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+18:5818:x1872533770002816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 179us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787612.555905:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1785787612.555940:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533770002816:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1785787612.556653:0:11071:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1785787612.556698:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1785787612.556713:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1785787612.556721:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff91905f903600/0xe2c2ff68a6e84565 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e8456c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787612.556731:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff91905f903600/0xe2c2ff68a6e84565 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e8456c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785787612.556741:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1785787612.556743:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff919056a98000 from 7 10000000:01000000:0.0:1785787612.556746:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1785787612.556766:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff919050678600/0xe2c2ff68a6e84573 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787612.556774:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff919050678600/0xe2c2ff68a6e84573 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787612.556782:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff919050678600/0xe2c2ff68a6e84573 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787612.556796:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b48ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533770002944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1785787612.556823:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787612.556857:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff91907fdff480 going to sleep for 11 seconds 00000100:00100000:0.0:1785787612.556870:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770002944 00000100:00100000:0.0:1785787612.556874:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770002944 00000100:00100000:0.0:1785787612.556893:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1785787612.556899:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+18:5818:x1872533770002944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785787612.556909:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787612.556929:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919050679a00/0xe2c2ff68a6e8457a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e84573 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787612.556948:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919050679a00/0xe2c2ff68a6e8457a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e84573 expref: 19 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787612.556958:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919050679a00/0xe2c2ff68a6e8457a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e84573 expref: 19 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787612.556976:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919050679a00, rc 0) 00000100:00100000:0.0:1785787612.557006:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+19:5818:x1872533770002944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787612.557012:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1785787612.557040:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b48ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533770002944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785787612.557050:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff919050678600/0xe2c2ff68a6e84573 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e8457a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787612.557059:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff919050678600/0xe2c2ff68a6e84573 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e8457a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787612.557091:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b48ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533770003072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785787612.557112:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787612.557124:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff91907fdff480 going to sleep for 11 seconds 00000100:00100000:0.0:1785787612.557133:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770003072 00000100:00100000:0.0:1785787612.557136:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770003072 00000100:00100000:0.0:1785787612.557149:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1785787612.557155:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+19:5818:x1872533770003072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785787612.557309:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+19:5818:x1872533770003072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 154us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787612.557321:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1785787612.557346:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b48ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533770003072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785787612.557367:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b48ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533770003200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785787612.557396:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787612.557407:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff91907fdff480 going to sleep for 11 seconds 00000100:00100000:0.0:1785787612.557417:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770003200 00000100:00100000:0.0:1785787612.557419:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770003200 00000100:00100000:0.0:1785787612.557433:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1785787612.557438:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051581050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+19:5818:x1872533770003200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785787612.557535:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051581050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+19:5818:x1872533770003200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787612.557542:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1785787612.557570:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b48ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533770003200:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1785787612.558224:0:11072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1785787612.558253:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1785787612.558262:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1785787612.558267:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff919050678600/0xe2c2ff68a6e84573 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e8457a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787612.558276:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff919050678600/0xe2c2ff68a6e84573 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e8457a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787612.667014:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787613.689131:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787613.827330:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787613.827389:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787613.827417:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744796672 00000100:00100000:3.0:1785787613.827432:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744796544 00000100:00100000:0.0:1785787613.827433:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744796672 00000100:00100000:3.0:1785787613.827442:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744796544 00000100:00100000:3.0:1785787613.827508:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 257 00000100:00100000:3.0:1785787613.827521:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051580050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2391:x1872533744796544:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1785787613.827541:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 114 00000100:00100000:0.0:1785787613.827557:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905069df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+6:2390:x1872533744796672:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1785787613.827610:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051580050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2391:x1872533744796544:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 89us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787613.827632:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 257 00000100:00100000:0.0:1785787613.827653:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905069df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+6:2390:x1872533744796672:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 99us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787613.827663:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 114 00000100:00080000:0.0:1785787613.827692:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785787613.840378:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787613.840448:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744796800 00000100:00100000:3.0:1785787613.840460:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744796800 00000100:00100000:3.0:1785787613.840541:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 115 00000100:00100000:3.0:1785787613.840553:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4ec65b7-e63e-42dc-becf-cba362002085+5:2391:x1872533744796800:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1785787613.840640:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4ec65b7-e63e-42dc-becf-cba362002085+5:2391:x1872533744796800:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 88us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787613.840648:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 115 00000100:00080000:0.0:1785787613.841023:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785787614.130997:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8642023-9103-4dbf-85d1-f204189bc871:3336:1872533770003328:0@lo:400:kworker.0 00000100:00100000:1.0:1785787614.131067:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787614.131112:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fe15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3336:1872533770003840:0@lo:400:kworker.0 00000100:00100000:1.0:1785787614.131136:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787614.131158:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785787614.131164:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fe16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770003712:0@lo:400:kworker.0 00000100:00100000:1.0:1785787614.131184:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787614.131209:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1872533770003456:0@lo:400:kworker.0 00000100:00100000:1.0:1785787614.131231:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787614.131248:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fe17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770003968:0@lo:400:kworker.0 00000100:00100000:1.0:1785787614.131268:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787614.131285:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785787614.131290:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3333:1872533770003584:0@lo:400:kworker.0 00000100:00100000:1.0:1785787614.131308:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787614.131334:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770003328 00000100:00100000:1.0:1785787614.131350:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770003328 00000100:00100000:1.0:1785787614.131388:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1785787614.131396:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051583c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+19:3336:x1872533770003328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787614.131441:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051583c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+19:3336:x1872533770003328:12345-0@lo:400:kworker.0 Request processed in 46us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787614.131448:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1785787614.131476:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770003840 00000100:00100000:1.0:1785787614.131480:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770003840 00000100:00100000:1.0:1785787614.131507:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770003456 00000100:00100000:1.0:1785787614.131510:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770003456 00000100:00100000:1.0:1785787614.131519:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770003584 00000100:00100000:1.0:1785787614.131521:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770003584 00000100:00100000:1.0:1785787614.131532:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1785787614.131537:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3336:x1872533770003840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787614.131712:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3336:x1872533770003840:12345-0@lo:400:kworker.0 Request processed in 27us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787614.131720:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1785787614.131732:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1785787614.131738:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907708a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1872533770003456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787614.134061:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907708a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1872533770003456:12345-0@lo:400:kworker.0 Request processed in 2316us (2822us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787614.134071:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1785787614.134091:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1785787614.134100:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1872533770003584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787614.134144:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1872533770003584:12345-0@lo:400:kworker.0 Request processed in 47us (2835us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787614.134150:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1785787614.134179:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770003712 00000100:00100000:1.0:1785787614.134185:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770003712 00000100:00100000:1.0:1785787614.134216:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770003968 00000100:00100000:1.0:1785787614.134219:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770003968 00000100:00100000:1.0:1785787614.134240:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1785787614.134247:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077088a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770003712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787614.134280:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077088a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770003712:12345-0@lo:400:kworker.0 Request processed in 34us (3095us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787614.134286:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1785787614.134298:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1785787614.134303:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770003968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787614.134328:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770003968:12345-0@lo:400:kworker.0 Request processed in 25us (3060us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787614.134333:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1785787614.134361:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785787614.134365:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785787614.134367:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1785787614.134543:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907fe16d80 x1872533770003712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787614.134558:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fe16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770003712:0@lo:400:kworker.0 00000100:00100000:1.0:1785787614.134568:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8642023-9103-4dbf-85d1-f204189bc871:3336:1872533770003328:0@lo:400:kworker.0 00000100:00100000:1.0:1785787614.134577:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fe15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3336:1872533770003840:0@lo:400:kworker.0 00000100:00100000:3.0:1785787614.148914:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1872533770003456:0@lo:400:kworker.0 00010000:00080000:3.0:1785787614.148937:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907fe17100 x1872533770003968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787614.148951:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fe17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770003968:0@lo:400:kworker.0 00000100:00100000:3.0:1785787614.148991:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3333:1872533770003584:0@lo:400:kworker.0 00000100:00100000:2.0:1785787614.652208:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785787614.652229:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770004096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785787614.652301:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787614.652362:0:6621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770004096 00000100:00100000:2.0:1785787614.652370:0:6621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770004096 00000100:00100000:2.0:1785787614.652420:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1785787614.652430:0:6621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770004096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785787614.652464:0:6621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785787614.652507:0:6621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770004096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787614.652514:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1785787614.652553:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919077a9b100 x1872533770004096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787630 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787614.652571:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770004096:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785787614.708671:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787615.732517:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785787616.706777:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785787616.706799:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770004224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785787616.706900:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787616.707962:0:8140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770004224 00000100:00100000:1.0:1785787616.707978:0:8140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770004224 00000100:00100000:1.0:1785787616.708032:0:8140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1785787616.708041:0:8140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770004224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785787616.708075:0:8140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785787616.708128:0:8140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770004224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (1227us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787616.708135:0:8140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1785787616.708154:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1785787616.708177:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919077714a80 x1872533770004224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787632 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787616.708195:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770004224:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1785787616.761154:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1785787616.786511:0:11248:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg353-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1785787617.779218:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787618.804942:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787618.945095:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787618.945135:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787618.945164:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787618.945324:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744797184 00000100:00100000:0.0:1785787618.945336:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744797184 00000100:00100000:0.0:1785787618.945397:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744797056 00000100:00100000:0.0:1785787618.945399:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744797056 00000100:00100000:0.0:1785787618.945420:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 119 00000100:00100000:0.0:1785787618.945430:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905069dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4ec65b7-e63e-42dc-becf-cba362002085+5:2390:x1872533744797184:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1785787618.945518:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905069dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4ec65b7-e63e-42dc-becf-cba362002085+5:2390:x1872533744797184:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 89us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787618.945526:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 119 00000100:00100000:0.0:1785787618.945542:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 120 00000100:00100000:0.0:1785787618.945548:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076edce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+6:2390:x1872533744797056:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1785787618.945569:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076edce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+6:2390:x1872533744797056:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 21us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787618.945575:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 120 00000100:00100000:1.0:1785787618.945748:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744796928 00000100:00100000:1.0:1785787618.945753:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744796928 00000100:00100000:1.0:1785787618.945788:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 259 00000100:00100000:1.0:1785787618.945795:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051582c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2390:x1872533744796928:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1785787618.945848:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051582c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2390:x1872533744796928:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 53us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787618.945854:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 259 00000100:00080000:3.0:1785787618.946203:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785787619.253533:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076edf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1872533770004480:0@lo:400:kworker.0 00000100:00100000:0.0:1785787619.253743:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770004736:0@lo:400:kworker.0 00000100:00100000:2.0:1785787619.254687:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076eddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8642023-9103-4dbf-85d1-f204189bc871:3336:1872533770004352:0@lo:400:kworker.0 00000100:00100000:1.0:1785787619.256167:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076edd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3334:1872533770004608:0@lo:400:kworker.0 00000100:00100000:0.0:1785787619.257364:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787619.257455:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770004736 00000100:00100000:0.0:1785787619.257465:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770004736 00000100:00100000:0.0:1785787619.257530:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1785787619.257541:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533770004736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787619.257633:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533770004736:12345-0@lo:400:kworker.0 Request processed in 93us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787619.257641:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1785787619.257677:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1785787619.257715:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076edca80 x1872533770004736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787619.257730:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770004736:0@lo:400:kworker.0 00000100:00100000:2.0:1785787619.262793:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787619.262884:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3336:1872533770004864:0@lo:400:kworker.0 00000100:00100000:2.0:1785787619.262946:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787619.263773:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770004352 00000100:00100000:0.0:1785787619.263783:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770004352 00000100:00100000:0.0:1785787619.263854:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1785787619.263864:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051581850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+19:3336:x1872533770004352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787619.263944:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051581850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+19:3336:x1872533770004352:12345-0@lo:400:kworker.0 Request processed in 81us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787619.263952:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1785787619.263989:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770004864 00000100:00100000:0.0:1785787619.265114:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770004864 00000100:00100000:0.0:1785787619.265167:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1785787619.265175:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3336:x1872533770004864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787619.265219:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3336:x1872533770004864:12345-0@lo:400:kworker.0 Request processed in 46us (2273us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787619.265226:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:0.0:1785787619.265250:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785787619.265284:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076eddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8642023-9103-4dbf-85d1-f204189bc871:3336:1872533770004352:0@lo:400:kworker.0 00000100:00100000:0.0:1785787619.265298:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3336:1872533770004864:0@lo:400:kworker.0 00000100:00100000:1.0:1785787619.265401:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787619.265496:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770004608 00000100:00100000:0.0:1785787619.265506:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770004608 00000100:00100000:0.0:1785787619.265549:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1785787619.265554:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3334:x1872533770004608:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1785787619.265660:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785787619.268460:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787619.268511:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076edf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770004992:0@lo:400:kworker.0 00000100:00100000:3.0:1785787619.268556:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787619.268931:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770004480 00000100:00100000:2.0:1785787619.268940:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770004480 00000100:00100000:2.0:1785787619.268990:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1785787619.269011:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076edc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1872533770004480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787619.269078:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076edc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1872533770004480:12345-0@lo:400:kworker.0 Request processed in 70us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787619.269086:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1785787619.271139:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770004992 00000100:00100000:1.0:1785787619.271149:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770004992 00000100:00100000:1.0:1785787619.271203:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1785787619.271212:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770004992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787619.271282:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770004992:12345-0@lo:400:kworker.0 Request processed in 71us (2724us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787619.271289:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1785787619.271316:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785787619.273747:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3334:x1872533770004608:12345-0@lo:400:kworker.0 Request processed in 8184us (8338us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787619.273761:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1785787619.285460:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076edf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1872533770004480:0@lo:400:kworker.0 00010000:00080000:3.0:1785787619.285486:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919076edf100 x1872533770004992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787619.285498:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076edf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770004992:0@lo:400:kworker.0 00000100:00100000:1.0:1785787619.289154:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076edd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3334:1872533770004608:0@lo:400:kworker.0 00000100:00100000:3.0:1785787619.763617:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785787619.763648:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bb36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770005120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785787619.763736:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787619.763909:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770005120 00000100:00100000:2.0:1785787619.763925:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770005120 00000100:00100000:2.0:1785787619.763999:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1785787619.764009:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076edf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770005120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785787619.764052:0:6620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785787619.764110:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076edf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770005120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787619.764117:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1785787619.764378:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907bb36a00 x1872533770005120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787635 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787619.764405:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bb36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770005120:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1785787619.827731:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787620.865891:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1785787621.065638:0:11347:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 16:06:59 (1785787619) === 00000100:00100000:2.0:1785787621.310363:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787621.310432:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787621.310457:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744797312 00000100:00100000:2.0:1785787621.310465:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744797312 00000100:00100000:2.0:1785787621.310515:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 14 00000100:00100000:2.0:1785787621.310524:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+6:2388:x1872533744797312:12345-192.168.203.53@tcp:41:mkdir.0 00000004:00000024:2.0:1785787621.310562:0:9295:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1785787621.310637:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+6:2388:x1872533744797312:12345-192.168.203.53@tcp:41:mkdir.0 Request processed in 115us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787621.310644:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 14 00000100:00100000:1.0:1785787621.313054:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744797440 00000100:00100000:1.0:1785787621.313062:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744797440 00000100:00100000:1.0:1785787621.313102:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 0 00000100:00100000:1.0:1785787621.313110:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:79280304-55c6-4698-bfc3-29d14648ba45+6:9706:x1872533744797440:12345-192.168.203.53@tcp:700:mkdir.0 00000100:00100000:1.0:1785787621.313165:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:79280304-55c6-4698-bfc3-29d14648ba45+6:9706:x1872533744797440:12345-192.168.203.53@tcp:700:mkdir.0 Request processed in 56us (2812us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787621.313182:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 0 00000100:00080000:1.0:1785787621.314267:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785787621.343132:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787621.343609:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744797696 00000100:00100000:0.0:1785787621.343618:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744797696 00000100:00100000:0.0:1785787621.343663:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 15 00000100:00100000:0.0:1785787621.343671:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076edf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+6:9706:x1872533744797696:12345-192.168.203.53@tcp:36:mkdir.0 00010000:00010000:0.0:1785787621.343719:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785787621.343887:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84462 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd244 expref: 6 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787621.343912:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919055acd200) 00010000:00010000:0.0:1785787621.343923:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785787621.344179:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919050678000/0xe2c2ff68a6e84581 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787621.344192:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919050678000/0xe2c2ff68a6e84581 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787621.344201:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919050678000/0xe2c2ff68a6e84581 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787621.344225:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919050679600/0xe2c2ff68a6e84588 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787621.344232:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919050679600/0xe2c2ff68a6e84588 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787621.344238:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919050679600/0xe2c2ff68a6e84588 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785787621.346667:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:0.0:1785787621.346680:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919050678000/0xe2c2ff68a6e84581 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787621.346689:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919050678000/0xe2c2ff68a6e84581 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787621.346696:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919050678000/0xe2c2ff68a6e84581 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787621.346702:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919050678000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1785787621.346707:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919050678000/0xe2c2ff68a6e84581 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787621.346714:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919050678000/0xe2c2ff68a6e84581 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787621.346727:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919059e3e100) 00010000:00010000:0.0:1785787621.346730:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785787621.346734:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919050678000/0xe2c2ff68a6e84581 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787621.346749:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919050678000/0xe2c2ff68a6e84581 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785787621.346764:0:5822:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000080b43e40 reply state 00000000851e3bf8 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff919050679600/0xe2c2ff68a6e84588 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787621.346784:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785787621.348319:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076edf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+7:9706:x1872533744797696:12345-192.168.203.53@tcp:36:mkdir.0 Request processed in 4642us (5187us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1785787621.348328:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 15 00010000:00010000:2.0:1785787621.356406:0:3319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919050679600/0xe2c2ff68a6e84588 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.356421:0:3319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919050679600/0xe2c2ff68a6e84588 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.356428:0:3319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919050679600/0xe2c2ff68a6e84588 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.356434:0:3319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919050679600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787621.356438:0:3319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919050679600/0xe2c2ff68a6e84588 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.356446:0:3319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919050679600/0xe2c2ff68a6e84588 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.356460:0:3319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff919059e3e000) 00010000:00010000:2.0:1785787621.356463:0:3319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787621.356468:0:3319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919050679600/0xe2c2ff68a6e84588 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.356474:0:3319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919050679600/0xe2c2ff68a6e84588 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787621.370217:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787621.370303:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744797824 00000100:00100000:2.0:1785787621.370311:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744797824 00000100:00100000:2.0:1785787621.370362:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 16 00000100:00100000:2.0:1785787621.370371:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+6:9708:x1872533744797824:12345-192.168.203.53@tcp:101:chmod.0 00010000:00010000:2.0:1785787621.370406:0:9295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787621.370427:0:9295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1000/0xe2c2ff68a6e8458f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd2c9 expref: -99 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.370483:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1200/0xe2c2ff68a6e84596 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.370495:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1200/0xe2c2ff68a6e84596 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.370505:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1200/0xe2c2ff68a6e84596 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787621.370558:0:9295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1785787621.370561:0:9295:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1785787621.370613:0:9295:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1200/0xe2c2ff68a6e84596 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.370637:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1000/0xe2c2ff68a6e8458f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd2c9 expref: 8 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.370757:0:9295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1200/0xe2c2ff68a6e84596 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd2c9 expref: 7 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.370767:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9190481f9b00) 00010000:00010000:2.0:1785787621.370816:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785787621.370820:0:9295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190413a1200, rc 0) 00000100:00100000:0.0:1785787621.371109:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+7:9708:x1872533744797824:12345-192.168.203.53@tcp:101:chmod.0 Request processed in 737us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787621.371117:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 16 00000100:00100000:1.0:1785787621.397485:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787621.397556:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744798080 00000100:00100000:3.0:1785787621.397565:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744798080 00000100:00100000:3.0:1785787621.397617:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 17 00000100:00100000:3.0:1785787621.397626:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+7:9708:x1872533744798080:12345-192.168.203.53@tcp:36:chmod.0 00010000:00010000:3.0:1785787621.397679:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787621.397702:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1200/0xe2c2ff68a6e84596 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd2c9 expref: 7 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.397719:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9190481f9b00) 00010000:00010000:3.0:1785787621.397729:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785787621.397750:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e8459d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.397762:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e8459d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.397780:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e8459d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785787621.398091:0:5821:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d90b4037 reply state 00000000e94440cc transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e8459d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787621.398100:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1785787621.398111:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1785787621.398182:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+8:9708:x1872533744798080:12345-192.168.203.53@tcp:36:chmod.0 Request processed in 557us (703us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1785787621.398189:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 17 00010000:00010000:3.0:1785787621.406197:0:3320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e8459d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.406214:0:3320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e8459d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.406222:0:3320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e8459d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.406229:0:3320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787621.406233:0:3320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e8459d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.406241:0:3320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e8459d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.406256:0:3320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919055acd000) 00010000:00010000:3.0:1785787621.406259:0:3320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785787621.406263:0:3320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e8459d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.406269:0:3320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e8459d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787621.436219:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787621.436309:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744798208 00000100:00100000:2.0:1785787621.436318:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744798208 00000100:00100000:2.0:1785787621.436371:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 18 00000100:00100000:2.0:1785787621.436393:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+7:9710:x1872533744798208:12345-192.168.203.53@tcp:101:chown.0 00010000:00010000:2.0:1785787621.436415:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787621.436436:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1000/0xe2c2ff68a6e845a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd2d0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.436493:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1200/0xe2c2ff68a6e845ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.436505:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1200/0xe2c2ff68a6e845ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.436517:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1200/0xe2c2ff68a6e845ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787621.436565:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1785787621.436569:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1785787621.436602:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1200/0xe2c2ff68a6e845ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.436624:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1000/0xe2c2ff68a6e845a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd2d0 expref: 9 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.436641:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1200/0xe2c2ff68a6e845ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd2d0 expref: 8 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.436650:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9190481f9b00) 00010000:00010000:2.0:1785787621.436652:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785787621.436655:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190413a1200, rc 0) 00000100:00100000:2.0:1785787621.439008:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+8:9710:x1872533744798208:12345-192.168.203.53@tcp:101:chown.0 Request processed in 2609us (2789us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787621.439031:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 18 00000100:00100000:2.0:1785787621.452740:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787621.452891:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744798336 00000100:00100000:3.0:1785787621.452899:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744798336 00000100:00100000:3.0:1785787621.452964:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 19 00000100:00100000:3.0:1785787621.452973:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+8:9710:x1872533744798336:12345-192.168.203.53@tcp:101:chown.0 00010000:00010000:3.0:1785787621.452992:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787621.453012:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e845b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd2d7 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.453069:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e845b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.453082:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e845b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.453092:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e845b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.453105:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e845c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.453111:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e845c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.453117:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e845c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.453204:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902a00/0xe2c2ff68a6e845c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.453212:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902a00/0xe2c2ff68a6e845c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.453232:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902a00/0xe2c2ff68a6e845c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785787621.453269:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:3.0:1785787621.453273:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1785787621.453295:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902a00/0xe2c2ff68a6e845c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.453306:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e845b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.453312:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e845b9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.453318:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e845b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.453324:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f902600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787621.453327:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e845b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.453334:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e845b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.453344:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9190481f9b00) 00010000:00010000:3.0:1785787621.453347:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787621.453351:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e845b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.453357:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e845b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.453380:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e845c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.453386:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e845c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.453392:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e845c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.453396:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903200 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787621.453399:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e845c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.453405:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e845c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.453411:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff919055acd000) 00010000:00010000:3.0:1785787621.453413:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787621.453416:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e845c0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.453420:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e845c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.453446:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e845b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd2d7 expref: 10 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.453457:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902a00/0xe2c2ff68a6e845c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd2d7 expref: 9 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.453473:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff919055acd300) 00010000:00010000:3.0:1785787621.453476:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785787621.453478:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f902a00, rc 0) 00000100:00100000:3.0:1785787621.453620:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+9:9710:x1872533744798336:12345-192.168.203.53@tcp:101:chown.0 Request processed in 648us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787621.453627:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 19 00000100:00100000:0.0:1785787621.462396:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787621.462477:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744798592 00000100:00100000:2.0:1785787621.462486:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744798592 00000100:00100000:2.0:1785787621.462540:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 20 00000100:00100000:2.0:1785787621.462549:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+9:9710:x1872533744798592:12345-192.168.203.53@tcp:36:chown.0 00010000:00010000:2.0:1785787621.462596:0:9295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785787621.462618:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902a00/0xe2c2ff68a6e845c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd2d7 expref: 9 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.462634:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff919055acd300) 00010000:00010000:2.0:1785787621.462651:0:9295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785787621.462675:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1000/0xe2c2ff68a6e845ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.462686:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1000/0xe2c2ff68a6e845ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.462694:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1000/0xe2c2ff68a6e845ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785787621.527914:0:9295:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004d41bd11 reply state 0000000027d8cc26 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1000/0xe2c2ff68a6e845ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787621.527933:0:9295:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1785787621.528057:0:9295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1785787621.528154:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+10:9710:x1872533744798592:12345-192.168.203.53@tcp:36:chown.0 Request processed in 65603us (65763us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1785787621.528163:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 20 00000001:00080000:1.0:1785787621.528280:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:1.0:1785787621.528302:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:2.0:1785787621.528887:0:3319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1000/0xe2c2ff68a6e845ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.528898:0:3319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1000/0xe2c2ff68a6e845ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.528915:0:3319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1000/0xe2c2ff68a6e845ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.528933:0:3319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413a1000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787621.528938:0:3319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1000/0xe2c2ff68a6e845ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.528947:0:3319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1000/0xe2c2ff68a6e845ce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.528962:0:3319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9190481f9c00) 00010000:00010000:2.0:1785787621.528965:0:3319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1785787621.528970:0:3319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1000/0xe2c2ff68a6e845ce lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.528977:0:3319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1000/0xe2c2ff68a6e845ce lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787621.547658:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787621.547745:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744798720 00000100:00100000:1.0:1785787621.547755:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744798720 00000100:00100000:1.0:1785787621.547809:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 21 00000100:00100000:1.0:1785787621.547818:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+6:9711:x1872533744798720:12345-192.168.203.53@tcp:101:touch.500 00010000:00010000:1.0:1785787621.547871:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787621.547894:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e845d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd2de expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785787621.550787:0:5822:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2837us 00010000:00010000:3.0:1785787621.569844:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e845dc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.569867:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e845dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.569879:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e845dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.569893:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e845e3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.569901:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e845e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.569927:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e845e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.570361:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e845ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.570370:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e845ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.570377:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e845ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785787621.570454:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1785787621.570458:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1785787621.570541:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e845ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.570553:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e845dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.570560:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e845dc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.570567:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e845dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.570573:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787621.570577:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e845dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.570584:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e845dc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.570602:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9190481f9b00) 00010000:00010000:3.0:1785787621.570605:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787621.570610:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e845dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.570617:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e845dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.570628:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e845e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.570634:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e845e3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.570640:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e845e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.570657:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903200 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787621.570660:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e845e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.570666:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e845e3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.570673:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff919055acd000) 00010000:00010000:3.0:1785787621.570676:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787621.570679:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e845e3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.570684:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e845e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.570732:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e845d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd2de expref: 8 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.570747:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e845ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd2de expref: 7 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.570755:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff919055acdc00) 00010000:00010000:3.0:1785787621.570757:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1785787621.570759:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f902600, rc 0) 00000100:00100000:3.0:1785787621.570844:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+7:9711:x1872533744798720:12345-192.168.203.53@tcp:101:touch.500 Request processed in 23008us (23175us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787621.570853:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 21 00000100:00100000:2.0:1785787621.579461:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787621.579717:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744798976 00000100:00100000:1.0:1785787621.579726:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744798976 00000100:00100000:1.0:1785787621.579785:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 22 00000100:00100000:1.0:1785787621.579800:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+7:9711:x1872533744798976:12345-192.168.203.53@tcp:101:touch.500 00010000:00010000:1.0:1785787621.579818:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787621.579854:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e845f1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd2e5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787621.580150:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e600/0xe2c2ff68a6e845f8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787621.580163:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e600/0xe2c2ff68a6e845f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787621.580176:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e600/0xe2c2ff68a6e845f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787621.580236:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e800/0xe2c2ff68a6e845ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787621.580245:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e800/0xe2c2ff68a6e845ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787621.580252:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e800/0xe2c2ff68a6e845ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785787621.581023:0:5820:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1785787621.581251:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84606 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787621.581261:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84606 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787621.581276:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84606 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787621.581307:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e600/0xe2c2ff68a6e845f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787621.581314:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e600/0xe2c2ff68a6e845f8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787621.581320:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e600/0xe2c2ff68a6e845f8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787621.581326:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0e600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787621.581330:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e600/0xe2c2ff68a6e845f8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787621.581336:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e600/0xe2c2ff68a6e845f8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787621.581346:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff919055acdc00) 00010000:00010000:1.0:1785787621.581349:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785787621.581353:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e600/0xe2c2ff68a6e845f8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787621.581359:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e600/0xe2c2ff68a6e845f8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785787621.581369:0:5820:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003d136e41 reply state 000000009d3e23a1 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e800/0xe2c2ff68a6e845ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787621.581376:0:5820:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785787621.581405:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e845f1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd2e5 expref: 10 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787621.581418:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84606 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd2e5 expref: 9 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787621.581425:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91905685f400) 00010000:00010000:1.0:1785787621.581427:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785787621.581429:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919043c0e400, rc 0) 00000100:00100000:1.0:1785787621.581492:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+10:9711:x1872533744798976:12345-192.168.203.53@tcp:101:touch.500 Request processed in 1693us (2039us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1785787621.581499:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 22 00010000:00010000:3.0:1785787621.583054:0:3320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e800/0xe2c2ff68a6e845ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.583067:0:3320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e800/0xe2c2ff68a6e845ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.583074:0:3320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e800/0xe2c2ff68a6e845ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.583079:0:3320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0e800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787621.583083:0:3320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e800/0xe2c2ff68a6e845ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.583090:0:3320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e800/0xe2c2ff68a6e845ff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.583101:0:3320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x3b9b2d99 (ffff91905685f900) 00010000:00010000:3.0:1785787621.583111:0:3320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787621.583116:0:3320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e800/0xe2c2ff68a6e845ff lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.583122:0:3320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e800/0xe2c2ff68a6e845ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787621.590135:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787621.590209:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744799232 00000100:00100000:3.0:1785787621.590218:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744799232 00000100:00100000:3.0:1785787621.590274:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 23 00000100:00100000:3.0:1785787621.590283:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+9:9711:x1872533744799232:12345-192.168.203.53@tcp:36:touch.500 00010000:00010000:3.0:1785787621.590335:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787621.590361:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84606 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd2e5 expref: 9 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.590376:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91905685f400) 00010000:00010000:3.0:1785787621.590387:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785787621.590426:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e84614 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.590438:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e84614 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.590447:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e84614 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785787621.590621:0:5821:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004f4d8874 reply state 000000006763f081 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e84614 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787621.590630:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785787621.590724:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+10:9711:x1872533744799232:12345-192.168.203.53@tcp:36:touch.500 Request processed in 441us (596us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1785787621.590742:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 23 00010000:00010000:1.0:1785787621.592223:0:3319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e84614 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787621.592236:0:3319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e84614 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787621.592243:0:3319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e84614 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787621.592250:0:3319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903200 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787621.592253:0:3319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e84614 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787621.592260:0:3319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e84614 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787621.592272:0:3319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff919055acd000) 00010000:00010000:1.0:1785787621.592275:0:3319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785787621.592289:0:3319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e84614 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787621.592296:0:3319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e84614 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787621.593584:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787621.593635:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744799360 00000100:00100000:3.0:1785787621.593644:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744799360 00000100:00100000:3.0:1785787621.593692:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 24 00000100:00100000:3.0:1785787621.593702:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+9:9711:x1872533744799360:12345-192.168.203.53@tcp:101:touch.500 00010000:00010000:3.0:1785787621.593724:0:9295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787621.593742:0:9295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e8461b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd2ec expref: -99 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.593804:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e8461b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd2ec expref: 10 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.593818:0:9295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e8461b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd2ec expref: 10 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.593865:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff919055acd900) 00010000:00010000:3.0:1785787621.593868:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785787621.593871:0:9295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f903800, rc 0) 00000100:00100000:3.0:1785787621.593923:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+10:9711:x1872533744799360:12345-192.168.203.53@tcp:101:touch.500 Request processed in 221us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787621.593928:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 24 00000100:00100000:2.0:1785787621.598068:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787621.598139:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744799488 00000100:00100000:0.0:1785787621.598148:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744799488 00000100:00100000:0.0:1785787621.598195:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 16 00000100:00100000:0.0:1785787621.598203:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b376300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2387:x1872533744799488:12345-192.168.203.53@tcp:8:touch.500 00010000:00080000:0.0:1785787621.598231:0:6617:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 79280304-55c6-4698-bfc3-29d14648ba45@192.168.203.53@tcp t0 exp 0000000000000000 cur 408 last 0 00000020:00000080:0.0:1785787621.598259:0:6617:0:(genops.c:1406:class_connect()) connect: client 79280304-55c6-4698-bfc3-29d14648ba45, cookie 0xe2c2ff68a6e84622 00002000:00100000:0.0:1785787621.598269:0:6617:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 79280304-55c6-4698-bfc3-29d14648ba45/ffff919045c78800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113801 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1785787621.598278:0:6617:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1785787621.598490:0:6617:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1785787621.598515:0:6617:0:(import.c:65:import_set_state_nolock()) ffff919045c7c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1785787621.598577:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b376300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:79280304-55c6-4698-bfc3-29d14648ba45+6:2387:x1872533744799488:12345-192.168.203.53@tcp:8:touch.500 Request processed in 373us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787621.598599:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 16 00000100:00100000:1.0:1785787621.615520:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787621.615730:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744799616 00000100:00100000:3.0:1785787621.615739:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744799616 00000100:00100000:3.0:1785787621.615814:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 17 00000100:00100000:3.0:1785787621.615825:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+6:0:x1872533744799616:12345-192.168.203.53@tcp:2:touch.500 00000100:00080000:1.0:1785787621.616141:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:0.0:1785787621.692501:0:7522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 79280304-55c6-4698-bfc3-29d14648ba45 00000001:00080000:0.0:1785787621.692518:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:1.0:1785787621.692669:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+5:0:x1872533744799616:12345-192.168.203.53@tcp:2:touch.500 Request processed in 76840us (77153us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1785787621.692680:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 17 00000100:00100000:1.0:1785787621.698728:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787621.699527:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744799872 00000100:00100000:3.0:1785787621.699550:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744799872 00000100:00100000:3.0:1785787621.699607:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2 00000100:00100000:3.0:1785787621.699616:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+10:9711:x1872533744799872:12345-192.168.203.53@tcp:35:touch.500 00000100:00100000:2.0:1785787621.707159:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+11:9711:x1872533744799872:12345-192.168.203.53@tcp:35:touch.500 Request processed in 7536us (8432us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1785787621.707170:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2 00000100:00100000:0.0:1785787621.741549:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787621.741657:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744800000 00000100:00100000:1.0:1785787621.741666:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744800000 00000100:00100000:1.0:1785787621.741730:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 25 00000100:00100000:1.0:1785787621.741738:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+11:9712:x1872533744800000:12345-192.168.203.53@tcp:101:rm.0 00010000:00010000:1.0:1785787621.741760:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787621.741784:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e600/0xe2c2ff68a6e84629 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd2f3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787621.741870:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e84630 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787621.741882:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e84630 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787621.741891:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e84630 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785787621.741949:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1785787621.741952:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1785787621.741997:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e84630 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787621.742020:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e600/0xe2c2ff68a6e84629 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd2f3 expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787621.742049:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e84630 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd2f3 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787621.742055:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff919055acdc00) 00010000:00010000:1.0:1785787621.742058:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785787621.742061:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919043c0f400, rc 0) 00000100:00100000:1.0:1785787621.742119:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+12:9712:x1872533744800000:12345-192.168.203.53@tcp:101:rm.0 Request processed in 380us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787621.742125:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 25 00000100:00100000:1.0:1785787621.752986:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787621.756728:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744800256 00000100:00100000:2.0:1785787621.756740:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744800256 00000100:00100000:2.0:1785787621.756976:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 26 00000100:00100000:2.0:1785787621.756987:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+12:9712:x1872533744800256:12345-192.168.203.53@tcp:101:rm.0 00010000:00010000:2.0:1785787621.757007:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787621.757028:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1c00/0xe2c2ff68a6e84637 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd2fa expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787621.757154:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1785787621.757301:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1c00/0xe2c2ff68a6e84637 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd2fa expref: 14 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.757314:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9190481f9b00) 00010000:00010000:2.0:1785787621.757317:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785787621.757321:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1c00/0xe2c2ff68a6e84637 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd2fa expref: 14 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.757335:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190413a1c00, rc 0) 00000100:00100000:2.0:1785787621.757403:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+13:9712:x1872533744800256:12345-192.168.203.53@tcp:101:rm.0 Request processed in 418us (4425us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1785787621.757410:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 26 00000100:00100000:1.0:1785787621.766359:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787621.766546:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744800384 00000100:00100000:0.0:1785787621.766554:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744800384 00000100:00100000:0.0:1785787621.766627:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 3 00000100:00100000:0.0:1785787621.766636:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+13:9712:x1872533744800384:12345-192.168.203.53@tcp:37:rm.0 00000100:00100000:1.0:1785787621.770368:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+13:9712:x1872533744800384:12345-192.168.203.53@tcp:37:rm.0 Request processed in 3724us (4008us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787621.770381:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 3 00000100:00100000:3.0:1785787621.773241:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787621.773308:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744800640 00000100:00100000:1.0:1785787621.773317:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744800640 00000100:00100000:1.0:1785787621.773369:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 4 00000100:00100000:1.0:1785787621.773379:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190451bf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+13:9712:x1872533744800640:12345-192.168.203.53@tcp:35:rm.0 00000100:00100000:1.0:1785787621.773606:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190451bf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+14:9712:x1872533744800640:12345-192.168.203.53@tcp:35:rm.0 Request processed in 228us (369us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1785787621.773614:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 4 00000100:00100000:2.0:1785787621.787017:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787621.787356:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744800896 00000100:00100000:1.0:1785787621.787378:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744800896 00000100:00100000:1.0:1785787621.787433:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 27 00000100:00100000:1.0:1785787621.787442:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+14:9712:x1872533744800896:12345-192.168.203.53@tcp:101:rm.0 00010000:00010000:1.0:1785787621.787464:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787621.787482:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e600/0xe2c2ff68a6e84645 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd301 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787621.787685:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e8464c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787621.787698:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e8464c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787621.787709:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e8464c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785787621.787719:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1785787621.789966:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e600/0xe2c2ff68a6e84645 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd301 expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787621.790003:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e8464c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd301 expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787621.790011:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff919055acdc00) 00010000:00010000:1.0:1785787621.790013:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1785787621.790016:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919043c0ec00, rc 0) 00000100:00100000:0.0:1785787621.790201:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+16:9712:x1872533744800896:12345-192.168.203.53@tcp:101:rm.0 Request processed in 2758us (3190us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1785787621.790210:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 27 00000100:00100000:2.0:1785787621.792261:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787621.792334:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744801024 00000100:00100000:3.0:1785787621.792342:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744801024 00000100:00100000:3.0:1785787621.792400:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 28 00000100:00100000:3.0:1785787621.792408:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+16:9712:x1872533744801024:12345-192.168.203.53@tcp:41:rm.0 00000004:00000024:3.0:1785787621.792454:0:9295:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1785787621.792503:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+16:9712:x1872533744801024:12345-192.168.203.53@tcp:41:rm.0 Request processed in 95us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787621.792509:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 28 00000100:00100000:3.0:1785787621.800328:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787621.800859:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744801152 00000100:00100000:2.0:1785787621.800868:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744801152 00000100:00100000:2.0:1785787621.800931:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 29 00000100:00100000:2.0:1785787621.800940:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076edca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+16:9712:x1872533744801152:12345-192.168.203.53@tcp:101:rm.0 00010000:00010000:2.0:1785787621.800958:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787621.800977:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1c00/0xe2c2ff68a6e8465a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd308 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.801029:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1000/0xe2c2ff68a6e84661 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.801057:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1000/0xe2c2ff68a6e84661 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.801068:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1000/0xe2c2ff68a6e84661 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.801095:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d600/0xe2c2ff68a6e84668 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.801102:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d600/0xe2c2ff68a6e84668 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.801110:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d600/0xe2c2ff68a6e84668 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.801204:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e8466f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.801212:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e8466f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.801220:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e8466f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787621.801245:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1785787621.801249:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785787621.801266:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e8466f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.801277:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e8466f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.801294:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1000/0xe2c2ff68a6e84661 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.801300:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1000/0xe2c2ff68a6e84661 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.801306:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1000/0xe2c2ff68a6e84661 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.801312:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413a1000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787621.801316:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1000/0xe2c2ff68a6e84661 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.801322:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1000/0xe2c2ff68a6e84661 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.801333:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff919055acdc00) 00010000:00010000:2.0:1785787621.801336:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787621.801340:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1000/0xe2c2ff68a6e84661 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.801346:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1000/0xe2c2ff68a6e84661 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.801359:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d600/0xe2c2ff68a6e84668 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.801364:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d600/0xe2c2ff68a6e84668 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.801370:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d600/0xe2c2ff68a6e84668 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.801380:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677d600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787621.801383:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d600/0xe2c2ff68a6e84668 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.801390:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d600/0xe2c2ff68a6e84668 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.801398:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x3b9b2d99 (ffff9190481f9c00) 00010000:00010000:2.0:1785787621.801401:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787621.801403:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d600/0xe2c2ff68a6e84668 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.801408:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d600/0xe2c2ff68a6e84668 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.801434:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1c00/0xe2c2ff68a6e8465a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd308 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.801447:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e8466f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd308 expref: 17 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787621.801455:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff919055acd900) 00010000:00010000:2.0:1785787621.801457:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785787621.801459:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677cc00, rc 0) 00000100:00100000:2.0:1785787621.801897:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076edca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+17:9712:x1872533744801152:12345-192.168.203.53@tcp:101:rm.0 Request processed in 957us (1574us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787621.801914:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 29 00000100:00100000:0.0:1785787621.811162:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919048782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770005248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785787621.811224:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787621.811350:0:6621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770005248 00000100:00100000:1.0:1785787621.811357:0:6621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770005248 00000100:00100000:1.0:1785787621.811422:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1785787621.811429:0:6621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533770005248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785787621.811470:0:6621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785787621.811508:0:6621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533770005248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787621.811514:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1785787621.811562:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1785787621.811587:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919048782300 x1872533770005248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787637 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787621.811602:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919048782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770005248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785787621.818693:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787621.818815:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744801408 00000100:00100000:3.0:1785787621.818866:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744801408 00000100:00100000:3.0:1785787621.818939:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 30 00000100:00100000:3.0:1785787621.818949:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+17:9712:x1872533744801408:12345-192.168.203.53@tcp:36:rm.0 00010000:00010000:3.0:1785787621.818999:0:9295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1785787621.819026:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e8466f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd308 expref: 17 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.819048:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e8461b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd2ec expref: 16 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.819061:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff919055acd900) 00010000:00010000:3.0:1785787621.819078:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e84630 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd2f3 expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.819105:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff919055acdc00) 00010000:00010000:3.0:1785787621.819108:0:9295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785787621.819130:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902a00/0xe2c2ff68a6e84676 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.819144:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902a00/0xe2c2ff68a6e84676 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.819154:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902a00/0xe2c2ff68a6e84676 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.819168:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e8467d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.819176:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e8467d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.819182:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e8467d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.819321:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e84684 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.819329:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e84684 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.819337:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e84684 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1785787621.819968:0:9295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1785787621.819977:0:9295:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 409064147929ns, next at 410064146124ns, rc = 0 00010000:00010000:3.0:1785787621.820030:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e8468b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.820039:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e8468b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.820047:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e8468b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.820053:0:9295:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e8468b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.820060:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e8468b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.820066:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e8468b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.820083:0:9295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1785787621.820098:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e84684 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.820105:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e84684 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.820111:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e84684 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.820117:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903c00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787621.820121:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e84684 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.820128:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e84684 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.820144:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff919055acd600) 00010000:00010000:3.0:1785787621.820146:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1785787621.820150:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e84684 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.820157:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e84684 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.820171:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902a00/0xe2c2ff68a6e84676 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.820177:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902a00/0xe2c2ff68a6e84676 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.820183:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902a00/0xe2c2ff68a6e84676 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.820188:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f902a00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787621.820190:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902a00/0xe2c2ff68a6e84676 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.820196:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902a00/0xe2c2ff68a6e84676 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.820202:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff919055acdc00) 00010000:00010000:3.0:1785787621.820205:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787621.820207:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902a00/0xe2c2ff68a6e84676 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.820213:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902a00/0xe2c2ff68a6e84676 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785787621.820232:0:9295:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000012238727 reply state 00000000035bc4c2 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e8467d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787621.820240:0:9295:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785787621.820318:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+16:9712:x1872533744801408:12345-192.168.203.53@tcp:36:rm.0 Request processed in 1370us (1632us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1785787621.820325:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 30 00010000:00010000:0.0:1785787621.820777:0:11050:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785787621.820784:0:11050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e8468b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787621.820791:0:11050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f902800 already unused, calling callback (ffffffffc174c300) 00010000:00010000:0.0:1785787621.820794:0:11050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e8468b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787621.820799:0:11050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e8468b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787621.820814:0:11050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff919055acd600) 00010000:00010000:0.0:1785787621.820816:0:11050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1785787621.820819:0:11050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e8468b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787621.820824:0:11050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e8468b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787621.820860:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787621.820862:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787621.820863:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787621.829958:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787621.830071:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744801664 00000100:00100000:1.0:1785787621.830080:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744801664 00000100:00100000:1.0:1785787621.830138:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 5 00000100:00100000:1.0:1785787621.830148:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+16:9712:x1872533744801664:12345-192.168.203.53@tcp:35:rm.0 00000100:00100000:1.0:1785787621.830412:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+17:9712:x1872533744801664:12345-192.168.203.53@tcp:35:rm.0 Request processed in 265us (463us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1785787621.830419:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 5 00010000:00010000:3.0:1785787621.836759:0:3320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e8467d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.837853:0:3320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e8467d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.837861:0:3320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e8467d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.837867:0:3320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903e00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787621.837870:0:3320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e8467d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.837877:0:3320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e8467d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.837891:0:3320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x3b9b2d99 (ffff919055acd300) 00010000:00010000:3.0:1785787621.837894:0:3320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787621.837899:0:3320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e8467d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.837912:0:3320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e8467d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787621.842117:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787621.842289:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744801920 00000100:00100000:3.0:1785787621.842299:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744801920 00000100:00100000:3.0:1785787621.842352:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 31 00000100:00100000:3.0:1785787621.842361:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+16:9712:x1872533744801920:12345-192.168.203.53@tcp:36:rm.0 00010000:00010000:3.0:1785787621.842409:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1785787621.842430:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e8464c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd301 expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.842448:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e845ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd2de expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.842458:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff919055acdc00) 00010000:00010000:3.0:1785787621.842470:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1200/0xe2c2ff68a6e845ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd2d0 expref: 14 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.842479:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9190481f9b00) 00010000:00010000:3.0:1785787621.842484:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785787621.842503:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902a00/0xe2c2ff68a6e84692 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.842514:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902a00/0xe2c2ff68a6e84692 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.842523:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902a00/0xe2c2ff68a6e84692 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.842532:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e84699 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.842554:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e84699 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.842560:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e84699 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.842823:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e846a0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.842848:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e846a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.842854:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e846a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785787621.843497:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1785787621.843510:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e846a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.843517:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e846a0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.843523:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e846a0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.843528:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787621.843532:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e846a0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.843538:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e846a0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.843555:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff919055acd000) 00010000:00010000:3.0:1785787621.843557:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1785787621.843561:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e846a0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.843567:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e846a0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.843583:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902a00/0xe2c2ff68a6e84692 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.843589:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902a00/0xe2c2ff68a6e84692 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.843595:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902a00/0xe2c2ff68a6e84692 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.843600:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f902a00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787621.843602:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902a00/0xe2c2ff68a6e84692 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.843608:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902a00/0xe2c2ff68a6e84692 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.843614:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919055acd900) 00010000:00010000:3.0:1785787621.843616:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787621.843619:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902a00/0xe2c2ff68a6e84692 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.843624:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902a00/0xe2c2ff68a6e84692 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785787621.843644:0:5822:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005fa1c3cb reply state 000000008e8bc4e0 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e84699 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787621.843652:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785787621.843721:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+15:9712:x1872533744801920:12345-192.168.203.53@tcp:36:rm.0 Request processed in 1360us (1610us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1785787621.843728:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 31 00010000:00010000:3.0:1785787621.846123:0:3319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e84699 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.846135:0:3319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e84699 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.846142:0:3319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e84699 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.846148:0:3319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903c00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787621.846151:0:3319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e84699 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.846157:0:3319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e84699 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.846177:0:3319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff919055acd800) 00010000:00010000:3.0:1785787621.846234:0:3319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787621.846239:0:3319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e84699 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787621.846246:0:3319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e84699 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787621.877651:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787622.902439:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787623.927314:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787624.083957:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787624.083985:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787624.084007:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787624.084030:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787624.084058:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744802176 00000100:00100000:0.0:1785787624.084066:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744802176 00000100:00100000:0.0:1785787624.084112:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744802432 00000100:00100000:0.0:1785787624.084115:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744802432 00000100:00100000:0.0:1785787624.084134:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 124 00000100:00100000:0.0:1785787624.084142:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+14:2390:x1872533744802176:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1785787624.084207:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+14:2390:x1872533744802176:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 66us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787624.084214:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 124 00000100:00100000:0.0:1785787624.084229:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 125 00000100:00100000:0.0:1785787624.084245:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4ec65b7-e63e-42dc-becf-cba362002085+5:2390:x1872533744802432:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1785787624.084267:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4ec65b7-e63e-42dc-becf-cba362002085+5:2390:x1872533744802432:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 23us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787624.084273:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 125 00000100:00100000:0.0:1785787624.084290:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744802048 00000100:00100000:0.0:1785787624.084293:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744802048 00000100:00100000:0.0:1785787624.084312:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 261 00000100:00100000:0.0:1785787624.084317:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051582450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2390:x1872533744802048:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1785787624.084335:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051582450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2390:x1872533744802048:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 18us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787624.084341:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 261 00000100:00100000:0.0:1785787624.084362:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744802304 00000100:00100000:0.0:1785787624.084365:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744802304 00000100:00100000:0.0:1785787624.084386:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 68 00000100:00100000:0.0:1785787624.084391:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:79280304-55c6-4698-bfc3-29d14648ba45+5:2390:x1872533744802304:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1785787624.084411:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:79280304-55c6-4698-bfc3-29d14648ba45+5:2390:x1872533744802304:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 20us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787624.084416:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 68 00000100:00080000:0.0:1785787624.084429:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785787624.084432:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785787624.372132:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919048781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3334:1872533770005632:0@lo:400:kworker.0 00000100:00100000:1.0:1785787624.372196:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787624.372245:0:3334:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1785787624.372251:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919048780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533770005504:0@lo:400:kworker.0 00000100:00100000:1.0:1785787624.372274:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787624.372463:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919048781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8642023-9103-4dbf-85d1-f204189bc871:3336:1872533770005376:0@lo:400:kworker.0 00000100:00100000:3.0:1785787624.372494:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787624.372519:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919048783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3336:1872533770005888:0@lo:400:kworker.0 00000100:00100000:3.0:1785787624.372544:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770005376 00000100:00100000:3.0:1785787624.372550:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770005376 00000100:00100000:3.0:1785787624.372590:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1785787624.372598:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051580c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+19:3336:x1872533770005376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787624.372640:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051580c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+19:3336:x1872533770005376:12345-0@lo:400:kworker.0 Request processed in 43us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787624.372647:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1785787624.372739:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919048781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770005760:0@lo:400:kworker.0 00000100:00100000:1.0:1785787624.372847:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919048781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770006016:0@lo:400:kworker.0 00000100:00100000:1.0:1785787624.372873:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787624.372931:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770006016 00000100:00100000:1.0:1785787624.372935:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770006016 00000100:00100000:1.0:1785787624.372970:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1785787624.372976:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770006016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787624.373011:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770006016:12345-0@lo:400:kworker.0 Request processed in 36us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787624.373032:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:1.0:1785787624.373071:0:3334:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919048781c00 x1872533770006016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787640 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787624.373083:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919048781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770006016:0@lo:400:kworker.0 00000100:00100000:0.0:1785787624.376989:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787624.377837:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770005632 00000100:00100000:2.0:1785787624.377846:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770005632 00000100:00100000:2.0:1785787624.378038:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770005504 00000100:00100000:2.0:1785787624.378042:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770005504 00000100:00100000:2.0:1785787624.378074:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1785787624.378083:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3334:x1872533770005632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787624.378141:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3334:x1872533770005632:12345-0@lo:400:kworker.0 Request processed in 60us (5946us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787624.378147:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1785787624.378161:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1785787624.378166:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533770005504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787624.378188:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533770005504:12345-0@lo:400:kworker.0 Request processed in 22us (5914us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787624.378192:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1785787624.378230:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919048780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533770005504:0@lo:400:kworker.0 00000100:00100000:2.0:1785787624.378241:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919048781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3334:1872533770005632:0@lo:400:kworker.0 00000100:00080000:0.0:1785787624.379266:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785787624.379271:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785787624.379283:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770005760 00000100:00100000:0.0:1785787624.379288:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770005760 00000100:00100000:0.0:1785787624.379342:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1785787624.379349:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533770005760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787624.379392:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533770005760:12345-0@lo:400:kworker.0 Request processed in 44us (2411us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787624.379398:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:0.0:1785787624.379431:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919048781180 x1872533770005760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787640 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787624.379442:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919048781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770005760:0@lo:400:kworker.0 00000100:00080000:3.0:1785787624.379481:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785787624.380066:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787624.380107:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919048781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8642023-9103-4dbf-85d1-f204189bc871:3336:1872533770005376:0@lo:400:kworker.0 00000100:00100000:0.0:1785787624.380909:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770005888 00000100:00100000:0.0:1785787624.380915:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770005888 00000100:00100000:0.0:1785787624.380960:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1785787624.380968:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905c5fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3336:x1872533770005888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787624.381015:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905c5fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3336:x1872533770005888:12345-0@lo:400:kworker.0 Request processed in 47us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787624.381022:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1785787624.381049:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919048783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3336:1872533770005888:0@lo:400:kworker.0 00000100:00080000:3.0:1785787624.381088:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1785787624.883092:0:7825:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 412127261665ns, next at 413127259729ns, rc = 0 00000100:00100000:0.0:1785787624.883113:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785787624.883131:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b48c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770006144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785787624.883193:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787624.884032:0:8140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770006144 00000100:00100000:3.0:1785787624.884040:0:8140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770006144 00000100:00100000:3.0:1785787624.884221:0:8140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1785787624.884230:0:8140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770006144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785787624.884263:0:8140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785787624.884313:0:8140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770006144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787624.884320:0:8140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:0.0:1785787624.884426:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907b48c380 x1872533770006144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787640 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787624.884442:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b48c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770006144:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1785787624.951861:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787625.971734:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1785787626.778190:0:11497:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:1.0:1785787626.932730:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785787626.932751:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919048781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770006272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785787626.932822:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787626.933018:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770006272 00000100:00100000:1.0:1785787626.933026:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770006272 00000100:00100000:1.0:1785787626.933075:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1785787626.933084:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770006272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785787626.933113:0:6620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785787626.933151:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770006272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787626.933157:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1785787626.933314:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919048781c00 x1872533770006272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787642 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1785787626.933478:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785787626.942027:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919048781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770006272:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1785787626.994911:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1785787626.998950:0:5843:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:1.0:1785787626.998972:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000001:00080000:1.0:1785787626.998994:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:1.0:1785787626.999000:0:5843:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1785787626.999137:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919048781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770006400:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1785787626.999194:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787626.999951:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770006400 00000100:00100000:1.0:1785787626.999958:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770006400 00000100:00100000:1.0:1785787627.000006:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1785787627.000015:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076edd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770006400:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1785787627.000044:0:6619:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1785787627.000072:0:6619:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a70f4e5, atime: 0x6a70f4e5, ctime: 0x6a70f4e5, blocks: 0x1 00010000:00010000:1.0:1785787627.000079:0:6619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aef30c8a/0xe2c2ff68a6e846a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787627.000094:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=414s v=(0 0) 00010000:00010000:1.0:1785787627.000098:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785787627.000104:0:6619:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aef30c8a/0xe2c2ff68a6e846a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787627.000119:0:6619:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aef30c8a/0xe2c2ff68a6e846a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787627.000128:0:6619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aef30c8a/0xe2c2ff68a6e846a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787627.000136:0:6619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aef30c8a/0xe2c2ff68a6e846a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787627.000150:0:6619:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1785787627.006717:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076edd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3336:x1872533770006400:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6697us (7515us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1785787627.006730:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1785787627.006771:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1785787627.006906:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785787627.006914:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aef30c8a/0xe2c2ff68a6e846a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787627.006940:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0e400 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785787627.006945:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aef30c8a/0xe2c2ff68a6e846a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787627.006956:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aef30c8a/0xe2c2ff68a6e846a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787627.006975:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aef30c8a/0xe2c2ff68a6e846a7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787627.006984:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aef30c8a/0xe2c2ff68a6e846a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787627.007001:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787627.007003:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787627.007005:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1785787627.007431:0:3336:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff919048781c00/2, rc 0, transno 4294967300 00000100:00100000:3.0:1785787627.007438:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919048781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770006400:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1785787628.027688:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1785787628.083569:0:11546:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe65ad80b0 20000000:00000080:1.0:1785787628.083587:0:11546:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91907fd66000 uarg=0000000000000000 20000000:01000000:1.0:1785787628.083621:0:11546:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1785787628.083627:0:11546:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1785787628.083633:0:11546:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1785787628.086255:0:11547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1785787628.090198:0:11546:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1785787628.105216:0:11546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1785787628.105265:0:11546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1785787628.105313:0:11546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1785787628.105331:0:11546:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1785787628.105350:0:11546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff919050679600/0xe2c2ff68a6e846ae lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787628.105368:0:11546:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919050678a00/0xe2c2ff68a6e84549 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd2bb expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787628.105376:0:11546:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919043c0ea00/0xe2c2ff68a6e84550 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd2c2 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787628.105383:0:11546:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91905f902c00/0xe2c2ff68a6e8455e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e84557 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787628.105390:0:11546:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919050679200/0xe2c2ff68a6e8456c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e84565 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787628.105397:0:11546:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919050679a00/0xe2c2ff68a6e8457a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e84573 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787628.105404:0:11546:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff919050679600/0xe2c2ff68a6e846ae lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787628.105441:0:11546:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919050679a00/0xe2c2ff68a6e8457a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2c2ff68a6e84573 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787628.105454:0:11546:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919050679a00/0xe2c2ff68a6e8457a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2c2ff68a6e84573 expref: 18 pid: 5812 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787628.105469:0:11546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b48c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11546:1872533770006528:0@lo:104: 00000100:00100000:0.0:1785787628.105536:0:11546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1785787628.105627:0:11546:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919050679200/0xe2c2ff68a6e8456c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2c2ff68a6e84565 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787628.105637:0:11546:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff919050679200/0xe2c2ff68a6e8456c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2c2ff68a6e84565 expref: 18 pid: 5814 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787628.105645:0:11546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b48c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11546:1872533770006656:0@lo:104: 00000100:00100000:0.0:1785787628.105667:0:11546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1785787628.109028:0:11546:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91905f902c00/0xe2c2ff68a6e8455e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2c2ff68a6e84557 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787628.109043:0:11546:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91905f902c00/0xe2c2ff68a6e8455e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2c2ff68a6e84557 expref: 18 pid: 5812 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787628.109055:0:11546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b48e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11546:1872533770006784:0@lo:104: 00000100:00100000:0.0:1785787628.109100:0:11546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787628.109840:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770006528 00000100:00100000:1.0:1785787628.109848:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770006528 00000100:00100000:3.0:1785787628.109927:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770006656 00000100:00100000:3.0:1785787628.109931:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770006656 00000100:00100000:3.0:1785787628.109953:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1785787628.109960:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8642023-9103-4dbf-85d1-f204189bc871+4:11546:x1872533770006528:12345-0@lo:104: 00010000:00010000:3.0:1785787628.109973:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff919050678600/0xe2c2ff68a6e84573 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e8457a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787628.110023:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1785787628.110028:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8642023-9103-4dbf-85d1-f204189bc871+4:11546:x1872533770006528:12345-0@lo:104: Request processed in 69us (4493us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787628.110035:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1785787628.110050:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1785787628.110056:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8642023-9103-4dbf-85d1-f204189bc871+3:11546:x1872533770006656:12345-0@lo:104: 00010000:00010000:3.0:1785787628.110063:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff91905f903600/0xe2c2ff68a6e84565 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e8456c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787628.110167:0:11050:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785787628.110174:0:11050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff919050678600/0xe2c2ff68a6e84573 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e8457a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787628.110181:0:11050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919050678600 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:2.0:1785787628.110185:0:11050:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff919050678600/0xe2c2ff68a6e84573 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2c2ff68a6e8457a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787628.110206:0:11050:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff919050678600/0xe2c2ff68a6e84573 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2c2ff68a6e8457a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785787628.110214:0:11050:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff919050678600/0xe2c2ff68a6e84573 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2c2ff68a6e8457a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785787628.110219:0:11050:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1785787628.110252:0:11050:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff919050678600/0xe2c2ff68a6e84573 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e8457a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787628.110259:0:11050:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785787628.110278:0:11050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff919050678600/0xe2c2ff68a6e84573 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e8457a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787628.110284:0:11050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff919050678600/0xe2c2ff68a6e84573 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e8457a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787628.110296:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787628.110298:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787628.110299:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785787628.110317:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905c5f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533770006912:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785787628.110345:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787628.110384:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770006912 00000100:00100000:2.0:1785787628.110387:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770006912 00010000:00010000:2.0:1785787628.110404:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919050679a00/0xe2c2ff68a6e8457a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e84573 expref: 19 pid: 5812 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787628.110423:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1785787628.110429:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905c5fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8642023-9103-4dbf-85d1-f204189bc871+19:3333:x1872533770006912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785787628.110445:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785787628.110451:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919050679a00/0xe2c2ff68a6e8457a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e84573 expref: 19 pid: 5812 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787628.110460:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919050679a00/0xe2c2ff68a6e8457a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2c2ff68a6e84573 expref: 19 pid: 5812 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787628.110474:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785787628.110498:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905c5fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8642023-9103-4dbf-85d1-f204189bc871+19:3333:x1872533770006912:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787628.110505:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1785787628.110539:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905c5f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533770006912:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785787628.112845:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1785787628.112865:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8642023-9103-4dbf-85d1-f204189bc871+3:11546:x1872533770006656:12345-0@lo:104: Request processed in 2799us (7188us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787628.112875:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1785787628.112954:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785787628.112961:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff91905f903600/0xe2c2ff68a6e84565 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e8456c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787628.112970:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903600 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:2.0:1785787628.112973:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff91905f903600/0xe2c2ff68a6e84565 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2c2ff68a6e8456c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787628.112982:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff91905f903600/0xe2c2ff68a6e84565 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2c2ff68a6e8456c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785787628.112989:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff91905f903600/0xe2c2ff68a6e84565 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2c2ff68a6e8456c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785787628.112993:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1785787628.113029:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff91905f903600/0xe2c2ff68a6e84565 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e8456c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787628.113047:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785787628.113064:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff91905f903600/0xe2c2ff68a6e84565 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e8456c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787628.113071:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff91905f903600/0xe2c2ff68a6e84565 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e8456c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787628.113083:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787628.113085:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787628.113087:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785787628.113108:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905c5f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533770007040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785787628.113147:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787628.113256:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770007040 00000100:00100000:3.0:1785787628.113261:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770007040 00010000:00010000:3.0:1785787628.113282:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919050679200/0xe2c2ff68a6e8456c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e84565 expref: 19 pid: 5814 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787628.113311:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1785787628.113318:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905c5fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d8642023-9103-4dbf-85d1-f204189bc871+19:3334:x1872533770007040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785787628.113335:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787628.113340:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919050679200/0xe2c2ff68a6e8456c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e84565 expref: 19 pid: 5814 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787628.113350:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919050679200/0xe2c2ff68a6e8456c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2c2ff68a6e84565 expref: 19 pid: 5814 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787628.113363:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787628.113396:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905c5fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d8642023-9103-4dbf-85d1-f204189bc871+19:3334:x1872533770007040:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787628.113402:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1785787628.113433:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905c5f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533770007040:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785787628.113558:0:11546:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919043c0ea00/0xe2c2ff68a6e84550 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd2c2 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787628.113570:0:11546:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff919043c0ea00/0xe2c2ff68a6e84550 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd2c2 expref: 12 pid: 5813 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787628.113581:0:11546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907712ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11546:1872533770007168:192.168.203.53@tcp:104: 00010000:00010000:0.0:1785787628.113661:0:11546:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919050678a00/0xe2c2ff68a6e84549 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd2bb expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787628.113669:0:11546:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff919050678a00/0xe2c2ff68a6e84549 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd2bb expref: 12 pid: 5813 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787628.113689:0:11546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077128380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11546:1872533770007296:192.168.203.53@tcp:104: 00000100:00100000:0.0:1785787628.113710:0:11546:0:(client.c:2702:ptlrpc_set_wait()) set ffff91907bdc2780 going to sleep for 11 seconds 00000100:00100000:3.0:1785787628.114170:0:5803:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1785787628.114180:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770006784 00000100:00100000:3.0:1785787628.114184:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770006784 00000100:00100000:3.0:1785787628.114201:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1785787628.114206:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8642023-9103-4dbf-85d1-f204189bc871+3:11546:x1872533770006784:12345-0@lo:104: 00010000:00010000:3.0:1785787628.114216:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff919043c0fe00/0xe2c2ff68a6e84557 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e8455e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787628.114249:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1785787628.114253:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8642023-9103-4dbf-85d1-f204189bc871+3:11546:x1872533770006784:12345-0@lo:104: Request processed in 47us (5163us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787628.114259:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1785787628.114289:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785787628.114294:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff919043c0fe00/0xe2c2ff68a6e84557 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e8455e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787628.114311:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0fe00 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:3.0:1785787628.114314:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff919043c0fe00/0xe2c2ff68a6e84557 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2c2ff68a6e8455e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787628.114321:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff919043c0fe00/0xe2c2ff68a6e84557 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2c2ff68a6e8455e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785787628.114327:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff919043c0fe00/0xe2c2ff68a6e84557 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2c2ff68a6e8455e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785787628.114332:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1785787628.114352:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff919043c0fe00/0xe2c2ff68a6e84557 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e8455e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787628.114358:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785787628.114372:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff919043c0fe00/0xe2c2ff68a6e84557 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e8455e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787628.114379:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff919043c0fe00/0xe2c2ff68a6e84557 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e8455e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787628.114392:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787628.114394:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787628.114395:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787628.114403:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8642023-9103-4dbf-85d1-f204189bc871:3335:1872533770007424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785787628.114427:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1785787628.114790:0:11546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919050679a00/0xe2c2ff68a6e8457a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2c2ff68a6e84573 expref: 18 pid: 5812 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787628.114803:0:11546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b48c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11546:1872533770006528:0@lo:104: 00010000:00010000:0.0:1785787628.114817:0:11546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919050679200/0xe2c2ff68a6e8456c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2c2ff68a6e84565 expref: 17 pid: 5814 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787628.114825:0:11546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b48c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11546:1872533770006656:0@lo:104: 00000100:00100000:0.0:1785787628.114849:0:11546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b48e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11546:1872533770006784:0@lo:104: 00000100:00100000:3.0:1785787628.115880:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770007424 00000100:00100000:3.0:1785787628.115886:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770007424 00010000:00010000:3.0:1785787628.115907:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91905f902c00/0xe2c2ff68a6e8455e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e84557 expref: 17 pid: 5812 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787628.115938:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1785787628.115944:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051464450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8642023-9103-4dbf-85d1-f204189bc871+17:3335:x1872533770007424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785787628.115953:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787628.115957:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91905f902c00/0xe2c2ff68a6e8455e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e84557 expref: 17 pid: 5812 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787628.115967:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91905f902c00/0xe2c2ff68a6e8455e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2c2ff68a6e84557 expref: 17 pid: 5812 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787628.115979:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91905f902c00/0xe2c2ff68a6e8455e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2c2ff68a6e84557 expref: 17 pid: 5812 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787628.115987:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787628.119229:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051464450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8642023-9103-4dbf-85d1-f204189bc871+16:3335:x1872533770007424:12345-0@lo:103:ldlm_bl.0 Request processed in 3280us (4796us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787628.119241:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1785787628.121993:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787628.122012:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787628.122157:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744802560 00000100:00100000:3.0:1785787628.122164:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744802560 00010000:00010000:3.0:1785787628.122196:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919043c0ea00/0xe2c2ff68a6e84550 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd2c2 expref: 13 pid: 5813 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787628.122248:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744802688 00000100:00100000:3.0:1785787628.122251:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744802688 00010000:00010000:3.0:1785787628.122263:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919050678a00/0xe2c2ff68a6e84549 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd2bb expref: 14 pid: 5813 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787628.122790:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8642023-9103-4dbf-85d1-f204189bc871:3335:1872533770007424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785787628.125720:0:11051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 33 00000100:00100000:0.0:1785787628.125750:0:11051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907712bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+14:2391:x1872533744802560:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785787628.125768:0:11051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785787628.125777:0:11051:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919043c0ea00/0xe2c2ff68a6e84550 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd2c2 expref: 14 pid: 5813 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787628.125790:0:11051:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919043c0ea00/0xe2c2ff68a6e84550 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd2c2 expref: 14 pid: 5813 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787628.125809:0:11051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785787628.125896:0:11051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907712bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+14:2391:x1872533744802560:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 155us (3907us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787628.125903:0:11051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 33 00000100:00100000:0.0:1785787628.125941:0:11051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 34 00000100:00100000:0.0:1785787628.125947:0:11051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907712aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2391:x1872533744802688:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785787628.125955:0:11051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785787628.125960:0:11051:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919050678a00/0xe2c2ff68a6e84549 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd2bb expref: 13 pid: 5813 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787628.125968:0:11051:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919050678a00/0xe2c2ff68a6e84549 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd2bb expref: 13 pid: 5813 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787628.125980:0:11051:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff919050679600/0xe2c2ff68a6e846ae lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787628.125987:0:11051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919050679600/0xe2c2ff68a6e846ae lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787628.126003:0:11051:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919050679600/0xe2c2ff68a6e846ae lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787628.126010:0:11051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919050679600/0xe2c2ff68a6e846ae lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787628.126017:0:11051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff919050679600/0xe2c2ff68a6e846ae lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787628.126023:0:11051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff919050679600/0xe2c2ff68a6e846ae lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787628.126029:0:11051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919050679600 already unused, calling callback (ffffffffc174c300) 00010000:00010000:0.0:1785787628.126033:0:11051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff919050679600/0xe2c2ff68a6e846ae lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787628.126050:0:11051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff919050679600/0xe2c2ff68a6e846ae lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787628.126058:0:11051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff919050679600/0xe2c2ff68a6e846ae lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787628.126068:0:11051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785787628.126085:0:11051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907712aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2391:x1872533744802688:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 138us (4072us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787628.126975:0:11051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 34 00010000:00010000:3.0:1785787628.127803:0:11546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919043c0ea00/0xe2c2ff68a6e84550 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd2c2 expref: 12 pid: 5813 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787628.127949:0:11546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907712ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11546:1872533770007168:192.168.203.53@tcp:104: 00010000:00010000:3.0:1785787628.127967:0:11546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919050678a00/0xe2c2ff68a6e84549 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd2bb expref: 11 pid: 5813 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787628.127976:0:11546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077128380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11546:1872533770007296:192.168.203.53@tcp:104: 00010000:00010000:3.0:1785787628.128012:0:11546:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff919050679600/0xe2c2ff68a6e846ae lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787628.128022:0:11546:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff919050679600/0xe2c2ff68a6e846ae lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787628.128028:0:11546:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff919050679600/0xe2c2ff68a6e846ae lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787628.128034:0:11546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919050679600/0xe2c2ff68a6e846ae lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787629.042972:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787629.184157:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787629.184202:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787629.184229:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787629.184260:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787629.184290:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744803072 00000100:00100000:0.0:1785787629.184299:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744803072 00000100:00100000:0.0:1785787629.184357:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 71 00000100:00100000:0.0:1785787629.184366:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077129500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:79280304-55c6-4698-bfc3-29d14648ba45+5:2388:x1872533744803072:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1785787629.184492:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744802944 00000100:00100000:1.0:1785787629.184509:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744802944 00000100:00100000:1.0:1785787629.184538:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744803200 00000100:00100000:1.0:1785787629.184541:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744803200 00000100:00100000:1.0:1785787629.184562:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 129 00000100:00100000:1.0:1785787629.184568:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+5:2389:x1872533744802944:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1785787629.184637:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+5:2389:x1872533744802944:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 67us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787629.184644:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 129 00000100:00100000:1.0:1785787629.184660:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 130 00000100:00100000:1.0:1785787629.184667:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4ec65b7-e63e-42dc-becf-cba362002085+5:2389:x1872533744803200:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1785787629.184691:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4ec65b7-e63e-42dc-becf-cba362002085+5:2389:x1872533744803200:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 25us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787629.184697:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 130 00000100:00080000:1.0:1785787629.184823:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1785787629.184858:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785787629.184996:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077129500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:79280304-55c6-4698-bfc3-29d14648ba45+5:2388:x1872533744803072:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 630us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787629.185003:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 71 00000100:00100000:2.0:1785787629.185220:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744802816 00000100:00100000:2.0:1785787629.185224:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744802816 00000100:00100000:2.0:1785787629.185268:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 263 00000100:00100000:2.0:1785787629.185276:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+11:2388:x1872533744802816:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:2.0:1785787629.185315:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+11:2388:x1872533744802816:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 41us (1166us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787629.185320:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 263 10000000:01000000:3.0:1785787629.363066:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1785787629.363073:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff91907fddf800 from 7 10000000:01000000:3.0:1785787629.363078:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1785787629.363137:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff91905f902c00/0xe2c2ff68a6e846b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787629.363149:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff91905f902c00/0xe2c2ff68a6e846b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787629.363159:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff91905f902c00/0xe2c2ff68a6e846b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787629.363200:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b374380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533770007552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1785787629.363277:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787629.363339:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff91904830b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785787629.363525:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770007552 00000100:00100000:0.0:1785787629.363532:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770007552 00000100:00100000:0.0:1785787629.363576:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1785787629.363584:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+16:5818:x1872533770007552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785787629.363607:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787629.363625:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919050679a00/0xe2c2ff68a6e846bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e846b5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787629.363646:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919050679a00/0xe2c2ff68a6e846bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e846b5 expref: 17 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787629.363657:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919050679a00/0xe2c2ff68a6e846bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e846b5 expref: 17 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787629.363666:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919050679a00, rc 0) 00000100:00100000:0.0:1785787629.363711:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+17:5818:x1872533770007552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787629.363876:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1785787629.364367:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b374380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533770007552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785787629.364381:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff91905f902c00/0xe2c2ff68a6e846b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e846bc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787629.364390:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff91905f902c00/0xe2c2ff68a6e846b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e846bc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787629.364444:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b374380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533770007680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785787629.364467:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787629.364499:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff91904830b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785787629.364619:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770007680 00000100:00100000:0.0:1785787629.364623:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770007680 00000100:00100000:0.0:1785787629.364652:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1785787629.364659:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+17:5818:x1872533770007680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785787629.364924:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+17:5818:x1872533770007680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 264us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787629.364930:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1785787629.365592:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b374380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533770007680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785787629.365622:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b374380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533770007808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785787629.365658:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787629.365682:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff91904830b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785787629.366179:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770007808 00000100:00100000:0.0:1785787629.366184:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770007808 00000100:00100000:0.0:1785787629.366222:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1785787629.366230:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+17:5818:x1872533770007808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785787629.368206:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+17:5818:x1872533770007808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1969us (2540us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787629.368218:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1785787629.375910:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b374380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533770007808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785787629.377545:0:11559:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919048782a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:11559:1872533770007936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785787629.387374:0:11559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787629.387539:0:11559:0:(client.c:2702:ptlrpc_set_wait()) set ffff918f42eee780 going to sleep for 11 seconds 00000100:00100000:0.0:1785787629.387705:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770007936 00000100:00100000:0.0:1785787629.387735:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770007936 00000100:00100000:0.0:1785787629.387786:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1785787629.387796:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+17:11559:x1872533770007936:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785787629.388037:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+17:11559:x1872533770007936:12345-0@lo:502:llog_process_th.0 Request processed in 242us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787629.388046:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1785787629.388231:0:11559:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919048782a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:11559:1872533770007936:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1785787629.388274:0:11559:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1785787629.388283:0:11559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785787629.388285:0:11559:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1785787629.388291:0:11559:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91907fddf800 00000020:00000080:3.0:1785787629.388293:0:11559:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1785787629.388381:0:11559:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b374380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:11559:1872533770008064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785787629.388439:0:11559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787629.388466:0:11559:0:(client.c:2702:ptlrpc_set_wait()) set ffff91904830b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785787629.390681:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770008064 00000100:00100000:0.0:1785787629.390690:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770008064 00000100:00100000:0.0:1785787629.390739:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1785787629.390748:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+17:11559:x1872533770008064:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785787629.390965:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+17:11559:x1872533770008064:12345-0@lo:502:llog_process_th.0 Request processed in 218us (2525us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787629.390973:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1785787629.391612:0:11559:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b374380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:11559:1872533770008064:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1785787629.391644:0:11559:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785787629.391652:0:11559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785787629.391654:0:11559:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1785787629.391659:0:11559:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1785787629.391920:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1785787629.391937:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1785787629.391947:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff91905f902c00/0xe2c2ff68a6e846b5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e846bc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787629.391958:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff91905f902c00/0xe2c2ff68a6e846b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e846bc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785787629.391968:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1785787629.391976:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff919048214000 from 7 10000000:01000000:1.0:1785787629.391979:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1785787629.392004:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff919043c0e600/0xe2c2ff68a6e846c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787629.392013:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff919043c0e600/0xe2c2ff68a6e846c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787629.392021:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff919043c0e600/0xe2c2ff68a6e846c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787629.392038:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919048780000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533770008192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1785787629.392072:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787629.393195:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff918f42eee480 going to sleep for 11 seconds 00000100:00100000:2.0:1785787629.407505:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770008192 00000100:00100000:2.0:1785787629.407519:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770008192 00000100:00100000:2.0:1785787629.407571:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1785787629.407580:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+17:5818:x1872533770008192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785787629.407602:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787629.407623:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91904677de00/0xe2c2ff68a6e846ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e846c3 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787629.407647:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91904677de00/0xe2c2ff68a6e846ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e846c3 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787629.407657:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91904677de00/0xe2c2ff68a6e846ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e846c3 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787629.407666:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677de00, rc 0) 00000100:00100000:2.0:1785787629.408069:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+18:5818:x1872533770008192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 490us (15996us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787629.408076:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1785787629.408206:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919048780000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533770008192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1785787629.408224:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff919043c0e600/0xe2c2ff68a6e846c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e846ca expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787629.408234:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff919043c0e600/0xe2c2ff68a6e846c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e846ca expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787629.408307:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919048780000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533770008320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785787629.408340:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787629.408376:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff918f42eee480 going to sleep for 11 seconds 00000100:00100000:2.0:1785787629.410169:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770008320 00000100:00100000:2.0:1785787629.410176:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770008320 00000100:00100000:2.0:1785787629.410216:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1785787629.410224:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+18:5818:x1872533770008320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1785787629.410469:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+18:5818:x1872533770008320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 246us (2128us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787629.410477:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1785787629.410875:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919048780000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533770008320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785787629.410912:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919048780000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533770008448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785787629.410951:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787629.410982:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff918f42eee480 going to sleep for 11 seconds 00000100:00100000:2.0:1785787629.411053:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770008448 00000100:00100000:2.0:1785787629.411057:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770008448 00000100:00100000:2.0:1785787629.411095:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1785787629.411102:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+18:5818:x1872533770008448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1785787629.411242:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+18:5818:x1872533770008448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787629.411249:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1785787629.411426:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919048780000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533770008448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785787629.417970:0:11561:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b374380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:11561:1872533770008576:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785787629.418044:0:11561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787629.418081:0:11561:0:(client.c:2702:ptlrpc_set_wait()) set ffff91904830b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785787629.418304:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770008576 00000100:00100000:2.0:1785787629.418317:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770008576 00000100:00100000:2.0:1785787629.418364:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1785787629.418374:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+18:11561:x1872533770008576:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785787629.418585:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+18:11561:x1872533770008576:12345-0@lo:502:llog_process_th.0 Request processed in 212us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787629.418603:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1785787629.418651:0:11561:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b374380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:11561:1872533770008576:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1785787629.418678:0:11561:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1785787629.418687:0:11561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785787629.418689:0:11561:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1785787629.418699:0:11561:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff919048214000 00000020:00000080:2.0:1785787629.418701:0:11561:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1785787629.418768:0:11561:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905c5f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:11561:1872533770008704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785787629.418799:0:11561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787629.418818:0:11561:0:(client.c:2702:ptlrpc_set_wait()) set ffff919046ec0300 going to sleep for 11 seconds 00000100:00100000:0.0:1785787629.419080:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770008704 00000100:00100000:0.0:1785787629.419092:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770008704 00000100:00100000:0.0:1785787629.419114:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1785787629.419121:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+18:11561:x1872533770008704:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785787629.419226:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+18:11561:x1872533770008704:12345-0@lo:502:llog_process_th.0 Request processed in 105us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787629.419233:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1785787629.420810:0:11561:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905c5f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:11561:1872533770008704:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1785787629.420872:0:11561:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1785787629.420878:0:11561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785787629.420880:0:11561:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1785787629.420887:0:11561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1785787629.421038:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1785787629.421054:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1785787629.421064:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff919043c0e600/0xe2c2ff68a6e846c3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e846ca expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787629.421075:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff919043c0e600/0xe2c2ff68a6e846c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e846ca expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785787629.421093:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1785787629.421096:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff919056a98000 from 7 10000000:01000000:3.0:1785787629.421099:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1785787629.421128:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff91905f902a00/0xe2c2ff68a6e846d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787629.421136:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff91905f902a00/0xe2c2ff68a6e846d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787629.421144:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff91905f902a00/0xe2c2ff68a6e846d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787629.421171:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b374380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533770008832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1785787629.421209:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787629.421242:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff91904830b000 going to sleep for 11 seconds 00000100:00100000:2.0:1785787629.422247:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770008832 00000100:00100000:2.0:1785787629.422254:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770008832 00000100:00100000:2.0:1785787629.422291:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1785787629.422298:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+18:5818:x1872533770008832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785787629.422309:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787629.422322:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91904677c000/0xe2c2ff68a6e846d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e846d1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787629.422355:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91904677c000/0xe2c2ff68a6e846d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e846d1 expref: 19 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787629.422365:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91904677c000/0xe2c2ff68a6e846d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e846d1 expref: 19 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787629.422373:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677c000, rc 0) 00000100:00100000:2.0:1785787629.422420:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+19:5818:x1872533770008832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787629.422426:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1785787629.422460:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b374380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533770008832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785787629.422473:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff91905f902a00/0xe2c2ff68a6e846d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e846d8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787629.422481:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff91905f902a00/0xe2c2ff68a6e846d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e846d8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787629.423658:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905c5f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533770008960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1785787629.423692:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787629.423813:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff919046ec0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1785787629.423844:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770008960 00000100:00100000:2.0:1785787629.423856:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770008960 00000100:00100000:2.0:1785787629.423882:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1785787629.423889:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+19:5818:x1872533770008960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785787629.424210:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905c5f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533770008960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785787629.424238:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b374380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533770009088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785787629.424285:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787629.424299:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff91904830bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1785787629.424310:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770009088 00000100:00100000:3.0:1785787629.424313:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770009088 00000100:00100000:3.0:1785787629.424330:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1785787629.424336:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+20:5818:x1872533770009088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785787629.424464:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+20:5818:x1872533770009088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787629.424471:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1785787629.424575:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b374380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8642023-9103-4dbf-85d1-f204189bc871:5818:1872533770009088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785787629.424934:0:11563:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b374380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:11563:1872533770009216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785787629.424967:0:11563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787629.424985:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770009216 00000100:00100000:3.0:1785787629.424988:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770009216 00000100:00100000:3.0:1785787629.425004:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1785787629.425009:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+20:11563:x1872533770009216:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785787629.426161:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+20:5818:x1872533770008960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2268us (2464us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787629.426180:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1785787629.427185:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+19:11563:x1872533770009216:12345-0@lo:502:llog_process_th.0 Request processed in 2173us (2215us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787629.427203:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1785787629.427242:0:11563:0:(client.c:2702:ptlrpc_set_wait()) set ffff91904830bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1785787629.428294:0:11563:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b374380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:11563:1872533770009216:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1785787629.428326:0:11563:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1785787629.428335:0:11563:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785787629.428337:0:11563:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1785787629.428343:0:11563:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff919056a98000 00000020:00000080:3.0:1785787629.428345:0:11563:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1785787629.428425:0:11563:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b374380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:11563:1872533770009344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785787629.428468:0:11563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787629.428487:0:11563:0:(client.c:2702:ptlrpc_set_wait()) set ffff91904830bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1785787629.428693:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770009344 00000100:00100000:0.0:1785787629.428700:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770009344 00000100:00100000:0.0:1785787629.428743:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1785787629.428751:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+19:11563:x1872533770009344:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785787629.428930:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+19:11563:x1872533770009344:12345-0@lo:502:llog_process_th.0 Request processed in 180us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787629.428944:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1785787629.429871:0:11563:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b374380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8642023-9103-4dbf-85d1-f204189bc871:11563:1872533770009344:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1785787629.429896:0:11563:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785787629.429902:0:11563:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785787629.429904:0:11563:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1785787629.429908:0:11563:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1785787629.432682:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1785787629.432709:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1785787629.432728:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff91905f902a00/0xe2c2ff68a6e846d1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e846d8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787629.432739:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff91905f902a00/0xe2c2ff68a6e846d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e846d8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1785787629.457061:0:11564:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1785787629.494036:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907712b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3335:1872533770009856:0@lo:400:kworker.0 00000100:00100000:0.0:1785787629.494110:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787629.494160:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1785787629.494166:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907712a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3335:1872533770009472:0@lo:400:kworker.0 00000100:00100000:0.0:1785787629.494188:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787629.494204:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770009984:0@lo:400:kworker.0 00000100:00100000:0.0:1785787629.494226:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787629.494266:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077128e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3333:1872533770009600:0@lo:400:kworker.0 00000100:00100000:0.0:1785787629.494289:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787629.494305:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785787629.494310:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907712a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770009728:0@lo:400:kworker.0 00000100:00100000:0.0:1785787629.494327:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787629.494352:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770009856 00000100:00100000:0.0:1785787629.494358:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770009856 00000100:00100000:0.0:1785787629.494410:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770009472 00000100:00100000:0.0:1785787629.494413:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770009472 00000100:00100000:0.0:1785787629.494425:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770009600 00000100:00100000:0.0:1785787629.494427:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770009600 00000100:00100000:0.0:1785787629.494441:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1785787629.494449:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3335:x1872533770009856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787629.494494:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3335:x1872533770009856:12345-0@lo:400:kworker.0 Request processed in 45us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787629.494501:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1785787629.494517:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1785787629.494533:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3335:x1872533770009472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787629.494567:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3335:x1872533770009472:12345-0@lo:400:kworker.0 Request processed in 35us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787629.494573:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1785787629.494583:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1785787629.495194:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907712b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1872533770009600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787629.495228:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907712b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1872533770009600:12345-0@lo:400:kworker.0 Request processed in 639us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787629.495234:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1785787629.495309:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770009984 00000100:00100000:0.0:1785787629.495313:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770009984 00000100:00100000:0.0:1785787629.495373:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770009728 00000100:00100000:0.0:1785787629.495376:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770009728 00000100:00100000:0.0:1785787629.496335:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1785787629.496347:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3335:x1872533770009984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787629.496383:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3335:x1872533770009984:12345-0@lo:400:kworker.0 Request processed in 39us (2156us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787629.496390:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1785787629.496468:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1785787629.496475:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077129c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770009728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787629.496505:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077129c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770009728:12345-0@lo:400:kworker.0 Request processed in 31us (2176us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787629.496511:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1785787629.497876:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785787629.497881:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785787629.497884:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1785787629.497923:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907712a300 x1872533770009728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787629.497949:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907712a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770009728:0@lo:400:kworker.0 00000100:00100000:0.0:1785787629.497965:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077128e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3333:1872533770009600:0@lo:400:kworker.0 00000100:00100000:0.0:1785787629.497995:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907712a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3335:1872533770009472:0@lo:400:kworker.0 00000100:00100000:0.0:1785787629.498006:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770009984:0@lo:400:kworker.0 00000100:00100000:0.0:1785787629.498014:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907712b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3335:1872533770009856:0@lo:400:kworker.0 00000100:00100000:2.0:1785787630.004473:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907712b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770010112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785787630.004544:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787630.004747:0:6621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770010112 00000100:00100000:1.0:1785787630.004755:0:6621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770010112 00000100:00100000:1.0:1785787630.004803:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1785787630.004812:0:6621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905c5fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3333:x1872533770010112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785787630.004867:0:6621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785787630.004912:0:6621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905c5fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3333:x1872533770010112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787630.004919:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1785787630.006212:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907712b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770010112:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1785787630.067940:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785787630.145471:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787630.146968:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744803328 00000100:00100000:3.0:1785787630.146979:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744803328 00000100:00100000:3.0:1785787630.147034:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 279 00000100:00100000:3.0:1785787630.147044:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+11:5611:x1872533744803328:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785787630.147059:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787630.147077:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91905f903c00/0xe2c2ff68a6e846df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd30f expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787630.147104:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91905f903c00/0xe2c2ff68a6e846df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd30f expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787630.147134:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91905f903c00/0xe2c2ff68a6e846df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd30f expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787630.147144:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f903c00, rc 0) 00000100:00100000:3.0:1785787630.147204:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+12:5611:x1872533744803328:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 Request processed in 160us (1742us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787630.147210:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 279 00000100:00100000:1.0:1785787630.160858:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787630.162183:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744803456 00000100:00100000:2.0:1785787630.162193:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744803456 00000100:00100000:2.0:1785787630.162242:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 280 00000100:00100000:2.0:1785787630.162257:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051539c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+12:5611:x1872533744803456:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1785787630.164394:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051539c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+12:5611:x1872533744803456:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 Request processed in 2138us (3568us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787630.164406:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 280 00000100:00100000:1.0:1785787630.179995:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787630.180493:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744803584 00000100:00100000:0.0:1785787630.180503:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744803584 00000100:00100000:0.0:1785787630.180568:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 281 00000100:00100000:0.0:1785787630.180578:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051539450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+12:5611:x1872533744803584:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785787630.181071:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051539450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+12:5611:x1872533744803584:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 Request processed in 493us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787630.181079:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 281 00000100:00100000:1.0:1785787630.185735:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787630.185824:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744803712 00000100:00100000:3.0:1785787630.185872:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744803712 00000100:00100000:3.0:1785787630.185927:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 282 00000100:00100000:3.0:1785787630.185937:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+12:9983:x1872533744803712:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1785787630.186229:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+12:9983:x1872533744803712:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 293us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787630.186237:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 282 00000100:00100000:1.0:1785787630.192229:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787630.192373:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744803840 00000100:00100000:0.0:1785787630.192381:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744803840 00000100:00100000:0.0:1785787630.192433:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 283 00000100:00100000:0.0:1785787630.192442:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051538850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+12:9983:x1872533744803840:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1785787630.192682:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051538850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+12:9983:x1872533744803840:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 240us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787630.192690:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 283 00000100:00100000:1.0:1785787630.216638:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787630.216961:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744803968 00000100:00100000:2.0:1785787630.216971:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744803968 00000100:00100000:2.0:1785787630.217024:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 284 00000100:00100000:2.0:1785787630.217033:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051538450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+12:5611:x1872533744803968:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785787630.217048:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787630.217074:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91904677c200/0xe2c2ff68a6e846e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd316 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787630.217120:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91904677c200/0xe2c2ff68a6e846e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd316 expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787630.217132:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91904677c200/0xe2c2ff68a6e846e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd316 expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787630.217143:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677c200, rc 0) 00000100:00100000:2.0:1785787630.217193:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051538450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:5611:x1872533744803968:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 Request processed in 161us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787630.217200:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 284 00000100:00100000:1.0:1785787630.234938:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787630.235342:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744804096 00000100:00100000:3.0:1785787630.235352:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744804096 00000100:00100000:3.0:1785787630.235408:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 285 00000100:00100000:3.0:1785787630.235418:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051538c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:5611:x1872533744804096:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785787630.235707:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051538c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:5611:x1872533744804096:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 Request processed in 289us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787630.235723:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 285 00000100:00100000:1.0:1785787630.243319:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787630.243442:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744804224 00000100:00100000:0.0:1785787630.243463:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744804224 00000100:00100000:0.0:1785787630.243520:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 286 00000100:00100000:0.0:1785787630.243529:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:5611:x1872533744804224:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785787630.243740:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:5611:x1872533744804224:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 Request processed in 211us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787630.243748:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 286 00000100:00100000:1.0:1785787630.257003:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787630.257295:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744804352 00000100:00100000:2.0:1785787630.257305:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744804352 00000100:00100000:2.0:1785787630.257355:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 287 00000100:00100000:2.0:1785787630.257363:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:9986:x1872533744804352:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1785787630.257607:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:9986:x1872533744804352:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 243us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787630.257614:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 287 00000100:00100000:1.0:1785787630.260693:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787630.260982:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744804480 00000100:00100000:3.0:1785787630.260995:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744804480 00000100:00100000:3.0:1785787630.261052:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 288 00000100:00100000:3.0:1785787630.261063:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051539050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:9986:x1872533744804480:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1785787630.272485:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051539050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:9986:x1872533744804480:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 11408us (11788us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787630.272502:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 288 00000040:00080000:1.0:1785787630.515923:0:11564:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1785787631.093112:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785787632.051695:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785787632.051747:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905c5faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770010240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785787632.052223:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787632.054372:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770010240 00000100:00100000:1.0:1785787632.054381:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770010240 00000100:00100000:1.0:1785787632.054431:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1785787632.054439:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b374380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770010240:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1785787632.054551:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1785787632.055819:0:6620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785787632.055928:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b374380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770010240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1488us (3705us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787632.055943:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:1.0:1785787632.055991:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91905c5faa00 x1872533770010240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787648 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787632.056009:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905c5faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770010240:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1785787632.115223:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1785787632.164901:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:2.0:1785787633.138996:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787634.163095:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785787634.305089:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787634.307376:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744804608 00000100:00100000:2.0:1785787634.307434:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744804608 00000100:00100000:2.0:1785787634.307499:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 289 00000100:00100000:2.0:1785787634.307508:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051538050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2391:x1872533744804608:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:2.0:1785787634.307588:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051538050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2391:x1872533744804608:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 81us (2508us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787634.307596:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 289 00000100:00100000:1.0:1785787634.308810:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787634.309072:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744804736 00000100:00100000:0.0:1785787634.309078:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744804736 00000100:00100000:0.0:1785787634.309172:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 134 00000100:00100000:0.0:1785787634.309187:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+5:2391:x1872533744804736:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1785787634.309237:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+5:2391:x1872533744804736:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 51us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787634.309243:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 134 00000100:00080000:2.0:1785787634.312431:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785787634.340177:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787634.340223:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787634.340293:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744804864 00000100:00100000:2.0:1785787634.340302:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744804864 00000100:00100000:0.0:1785787634.340311:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744804992 00000100:00100000:0.0:1785787634.340315:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744804992 00000100:00100000:0.0:1785787634.340368:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 135 00000100:00100000:0.0:1785787634.340377:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4ec65b7-e63e-42dc-becf-cba362002085+5:2390:x1872533744804992:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:2.0:1785787634.340407:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 74 00000100:00100000:2.0:1785787634.340415:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:79280304-55c6-4698-bfc3-29d14648ba45+5:2390:x1872533744804864:12345-192.168.203.53@tcp:400:kworker.0 00000100:00080000:3.0:1785787634.340471:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1785787634.340476:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785787634.340679:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4ec65b7-e63e-42dc-becf-cba362002085+5:2390:x1872533744804992:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 302us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787634.340695:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 135 00000100:00100000:2.0:1785787634.343474:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:79280304-55c6-4698-bfc3-29d14648ba45+5:2390:x1872533744804864:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 3052us (3243us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787634.343486:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 74 00000100:00100000:1.0:1785787634.611407:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907712a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3333:1872533770010624:0@lo:400:kworker.0 00000100:00100000:1.0:1785787634.611470:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787634.611593:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907712b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8642023-9103-4dbf-85d1-f204189bc871:3335:1872533770010368:0@lo:400:kworker.0 00000100:00100000:2.0:1785787634.611630:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787634.611659:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785787634.611666:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3335:1872533770010496:0@lo:400:kworker.0 00000100:00100000:2.0:1785787634.611722:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787634.611772:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770010368 00000100:00100000:3.0:1785787634.611962:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770010624 00000100:00100000:3.0:1785787634.611968:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770010624 00000100:00100000:3.0:1785787634.612014:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770010496 00000100:00100000:3.0:1785787634.612018:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770010496 00000100:00100000:3.0:1785787634.612037:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1785787634.612046:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1872533770010624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787634.612115:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770010368 00000100:00100000:2.0:1785787634.612141:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1785787634.612147:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+19:3335:x1872533770010368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787634.612179:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+19:3335:x1872533770010368:12345-0@lo:400:kworker.0 Request processed in 32us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787634.612186:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1785787634.612238:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907712b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8642023-9103-4dbf-85d1-f204189bc871:3335:1872533770010368:0@lo:400:kworker.0 00000100:00080000:2.0:1785787634.612263:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785787634.612286:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1785787634.612294:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905c5f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3335:x1872533770010496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787634.612328:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905c5f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3335:x1872533770010496:12345-0@lo:400:kworker.0 Request processed in 35us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787634.612334:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1785787634.612358:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3335:1872533770010496:0@lo:400:kworker.0 00000100:00100000:2.0:1785787634.613596:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077128e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770010752:0@lo:400:kworker.0 00000100:00100000:2.0:1785787634.613634:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787634.613691:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770010752 00000100:00100000:2.0:1785787634.613703:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770010752 00000100:00100000:2.0:1785787634.613740:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1785787634.613758:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905c5f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770010752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787634.614150:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905c5f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770010752:12345-0@lo:400:kworker.0 Request processed in 402us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787634.614157:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1785787634.614173:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1785787634.614192:0:3334:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff919077128e00 x1872533770010752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787650 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787634.614204:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077128e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770010752:0@lo:400:kworker.0 00000100:00100000:3.0:1785787634.616097:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1872533770010624:12345-0@lo:400:kworker.0 Request processed in 4046us (4620us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787634.616108:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1785787634.618098:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907712b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770011008:0@lo:400:kworker.0 00000100:00100000:3.0:1785787634.618154:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787634.618192:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785787634.618198:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907712a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3336:1872533770010880:0@lo:400:kworker.0 00000100:00100000:3.0:1785787634.618221:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787634.618249:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770010880 00000100:00100000:3.0:1785787634.618255:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770010880 00000100:00100000:3.0:1785787634.618313:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1785787634.618321:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3336:x1872533770010880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787634.618363:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3336:x1872533770010880:12345-0@lo:400:kworker.0 Request processed in 43us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787634.618370:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:3.0:1785787634.618424:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785787634.618448:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907712a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3336:1872533770010880:0@lo:400:kworker.0 00000100:00100000:0.0:1785787634.618515:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770011008 00000100:00100000:0.0:1785787634.618520:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770011008 00000100:00100000:0.0:1785787634.618565:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1785787634.618572:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905069ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770011008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787634.618611:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905069ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770011008:12345-0@lo:400:kworker.0 Request processed in 40us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787634.618624:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1785787634.619305:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785787634.619325:0:3336:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1785787634.619331:0:3336:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff919048781c00, transno 4294967300 00000100:00100000:3.0:1785787634.619348:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907712b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770011008:0@lo:400:kworker.0 00000100:00100000:1.0:1785787634.620372:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907712a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3333:1872533770010624:0@lo:400:kworker.0 00000100:00100000:1.0:1785787635.123227:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907712a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770011136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785787635.123295:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787635.123579:0:8140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770011136 00000100:00100000:3.0:1785787635.123588:0:8140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770011136 00000100:00100000:3.0:1785787635.123633:0:8140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1785787635.123641:0:8140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770011136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785787635.123672:0:8140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785787635.123731:0:8140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770011136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787635.123738:0:8140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1785787635.123925:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907712a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770011136:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1785787635.187685:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787636.211098:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785787637.171748:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905c5f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770011264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785787637.171845:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787637.172179:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770011264 00000100:00100000:1.0:1785787637.172188:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770011264 00000100:00100000:1.0:1785787637.172246:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1785787637.172255:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905c5fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770011264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785787637.172287:0:6620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785787637.172331:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905c5fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770011264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787637.172339:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:1.0:1785787637.172375:0:3334:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91905c5f9500 x1872533770011264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787653 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787637.172404:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905c5f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770011264:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1785787637.176222:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1785787637.236688:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787638.259211:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787639.285084:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787639.431199:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787639.431253:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787639.431421:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744805248 00000100:00100000:3.0:1785787639.431430:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744805248 00000100:00100000:3.0:1785787639.431502:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 139 00000100:00100000:3.0:1785787639.431512:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907712b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+5:2388:x1872533744805248:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1785787639.431578:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907712b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+5:2388:x1872533744805248:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 67us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787639.431584:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 139 00000100:00080000:1.0:1785787639.431817:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785787639.432137:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744805120 00000100:00100000:2.0:1785787639.432142:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744805120 00000100:00100000:2.0:1785787639.432182:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 291 00000100:00100000:2.0:1785787639.432189:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2388:x1872533744805120:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:2.0:1785787639.432304:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2388:x1872533744805120:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 115us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787639.432311:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 291 00000100:00100000:1.0:1785787639.440123:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787639.440318:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787639.440536:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744805376 00000100:00100000:2.0:1785787639.440545:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744805376 00000100:00100000:2.0:1785787639.440607:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 77 00000100:00100000:2.0:1785787639.440617:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048782a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:79280304-55c6-4698-bfc3-29d14648ba45+5:2388:x1872533744805376:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:2.0:1785787639.440690:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048782a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:79280304-55c6-4698-bfc3-29d14648ba45+5:2388:x1872533744805376:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 75us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787639.440697:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 77 00000100:00100000:3.0:1785787639.440886:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744805504 00000100:00100000:3.0:1785787639.440891:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744805504 00000100:00100000:3.0:1785787639.441305:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 140 00000100:00100000:3.0:1785787639.441314:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4ec65b7-e63e-42dc-becf-cba362002085+5:2389:x1872533744805504:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1785787639.441359:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4ec65b7-e63e-42dc-becf-cba362002085+5:2389:x1872533744805504:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 46us (1244us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787639.441378:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 140 00000100:00080000:1.0:1785787639.441488:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1785787639.441492:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785787639.731119:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3333:1872533770011648:0@lo:400:kworker.0 00000100:00100000:3.0:1785787639.731137:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907712a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8642023-9103-4dbf-85d1-f204189bc871:3335:1872533770011392:0@lo:400:kworker.0 00000100:00100000:1.0:1785787639.731288:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077128e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3336:1872533770011520:0@lo:400:kworker.0 00000100:00100000:2.0:1785787639.734267:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907712b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770011776:0@lo:400:kworker.0 00000100:00100000:3.0:1785787639.738542:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787639.738598:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3335:1872533770011904:0@lo:400:kworker.0 00000100:00100000:3.0:1785787639.738630:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787639.739666:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770011904 00000100:00100000:3.0:1785787639.739675:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770011904 00000100:00100000:3.0:1785787639.739730:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1785787639.739739:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3335:x1872533770011904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787639.739902:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3335:x1872533770011904:12345-0@lo:400:kworker.0 Request processed in 162us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787639.739909:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:3.0:1785787639.739930:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785787639.739957:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3335:1872533770011904:0@lo:400:kworker.0 00000100:00100000:3.0:1785787639.739989:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770011392 00000100:00100000:3.0:1785787639.739993:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770011392 00000100:00100000:3.0:1785787639.740013:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1785787639.740018:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051539850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+19:3335:x1872533770011392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787639.740048:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051539850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+19:3335:x1872533770011392:12345-0@lo:400:kworker.0 Request processed in 30us (1511us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787639.740053:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1785787639.740082:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907712a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8642023-9103-4dbf-85d1-f204189bc871:3335:1872533770011392:0@lo:400:kworker.0 00000100:00100000:0.0:1785787639.741447:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787639.742465:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770011648 00000100:00100000:3.0:1785787639.742471:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770011648 00000100:00100000:3.0:1785787639.742525:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1785787639.742532:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907712a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1872533770011648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787639.742580:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907712a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1872533770011648:12345-0@lo:400:kworker.0 Request processed in 47us (1135us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787639.742587:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:0.0:1785787639.743450:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785787639.743480:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3333:1872533770011648:0@lo:400:kworker.0 00000100:00100000:1.0:1785787639.745780:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787639.745914:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907712ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770012032:0@lo:400:kworker.0 00000100:00100000:1.0:1785787639.745949:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787639.746022:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770012032 00000100:00100000:0.0:1785787639.746028:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770012032 00000100:00100000:0.0:1785787639.746077:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1785787639.746085:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048781f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770012032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787639.746127:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048781f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770012032:12345-0@lo:400:kworker.0 Request processed in 44us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787639.746133:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1785787639.746165:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907712ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770012032:0@lo:400:kworker.0 00000100:00080000:1.0:1785787639.746221:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785787639.747070:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787639.747605:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770011776 00000100:00100000:0.0:1785787639.747610:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770011776 00000100:00100000:0.0:1785787639.747662:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1785787639.747670:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905c5f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770011776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787639.747716:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905c5f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770011776:12345-0@lo:400:kworker.0 Request processed in 47us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787639.747722:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1785787639.747869:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1785787639.747956:0:3334:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907712b100 x1872533770011776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787655 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787639.747970:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907712b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770011776:0@lo:400:kworker.0 00000100:00100000:3.0:1785787639.748467:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770011520 00000100:00100000:3.0:1785787639.748473:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770011520 00000100:00100000:3.0:1785787639.748540:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1785787639.748548:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3336:x1872533770011520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787639.748600:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3336:x1872533770011520:12345-0@lo:400:kworker.0 Request processed in 53us (2830us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787639.748607:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1785787639.748670:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077128e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3336:1872533770011520:0@lo:400:kworker.0 00000100:00100000:2.0:1785787640.243132:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907712ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770012160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785787640.243199:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787640.243319:0:6621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770012160 00000100:00100000:0.0:1785787640.243327:0:6621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770012160 00000100:00100000:0.0:1785787640.243381:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1785787640.243401:0:6621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905c5fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770012160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785787640.243433:0:6621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785787640.243472:0:6621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905c5fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770012160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787640.243478:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1785787640.243615:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907712ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770012160:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1785787640.307095:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1785787640.755534:0:11564:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1785787641.331072:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785787642.291085:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905c5fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770012288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785787642.291148:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787642.291217:0:8140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770012288 00000100:00100000:2.0:1785787642.291224:0:8140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770012288 00000100:00100000:2.0:1785787642.291273:0:8140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1785787642.291282:0:8140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905c5f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770012288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785787642.291310:0:8140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785787642.291350:0:8140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905c5f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770012288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787642.291357:0:8140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1785787642.291376:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1785787642.291402:0:3334:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91905c5fb100 x1872533770012288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787658 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787642.291418:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905c5fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770012288:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1785787642.354978:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787643.379932:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787644.402977:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787644.543036:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787644.543079:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787644.543226:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744805760 00000100:00100000:2.0:1785787644.543235:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744805760 00000100:00100000:2.0:1785787644.543309:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 144 00000100:00100000:2.0:1785787644.543320:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+5:2388:x1872533744805760:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:2.0:1785787644.543385:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+5:2388:x1872533744805760:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 68us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787644.543393:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 144 00000100:00080000:1.0:1785787644.543464:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785787644.543514:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744805632 00000100:00100000:3.0:1785787644.543519:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744805632 00000100:00100000:3.0:1785787644.543551:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 293 00000100:00100000:3.0:1785787644.543557:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2388:x1872533744805632:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1785787644.543581:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2388:x1872533744805632:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 25us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787644.543586:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 293 00000100:00100000:0.0:1785787644.565423:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787644.565475:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787644.565555:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744806016 00000100:00100000:3.0:1785787644.565564:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744806016 00000100:00100000:3.0:1785787644.565634:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 145 00000100:00100000:3.0:1785787644.565644:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907712a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4ec65b7-e63e-42dc-becf-cba362002085+5:2389:x1872533744806016:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1785787644.565710:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907712a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4ec65b7-e63e-42dc-becf-cba362002085+5:2389:x1872533744806016:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 67us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787644.565717:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 145 00000100:00080000:1.0:1785787644.565810:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785787644.566485:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744805888 00000100:00100000:2.0:1785787644.566497:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744805888 00000100:00100000:2.0:1785787644.566538:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 19 00000100:00100000:2.0:1785787644.566546:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077128380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+5:2387:x1872533744805888:12345-192.168.203.53@tcp:9:kworker.0 00000020:00000080:2.0:1785787644.566565:0:6618:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2c2ff68a6e84622 00000100:00080000:2.0:1785787644.566571:0:6618:0:(import.c:65:import_set_state_nolock()) ffff919045c7c000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1785787644.566614:0:6618:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:3.0:1785787644.566878:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1785787644.566918:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785787644.567882:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077128380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+2:2387:x1872533744805888:12345-192.168.203.53@tcp:9:kworker.0 Request processed in 1332us (2461us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787644.567891:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 19 00000100:00100000:2.0:1785787644.852211:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905c5f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770012800:0@lo:400:kworker.0 00000100:00100000:2.0:1785787644.852270:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787644.852331:0:3334:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785787644.852338:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905c5f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3334:1872533770012672:0@lo:400:kworker.0 00000100:00100000:2.0:1785787644.852362:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787644.852397:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770012800 00000100:00100000:2.0:1785787644.852404:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770012800 00000100:00100000:2.0:1785787644.852453:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1785787644.852462:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905c5f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770012800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787644.852509:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905c5f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770012800:12345-0@lo:400:kworker.0 Request processed in 48us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787644.852517:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:2.0:1785787644.852555:0:3334:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91905c5f9180 x1872533770012800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787644.852568:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905c5f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770012800:0@lo:400:kworker.0 00000100:00100000:2.0:1785787644.852587:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770012672 00000100:00100000:2.0:1785787644.852591:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770012672 00000100:00100000:2.0:1785787644.852630:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1785787644.852636:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905c5fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3334:x1872533770012672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787644.852668:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905c5fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3334:x1872533770012672:12345-0@lo:400:kworker.0 Request processed in 32us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787644.852673:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1785787644.852693:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905c5f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3334:1872533770012672:0@lo:400:kworker.0 00000100:00100000:1.0:1785787644.852964:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905c5f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3336:1872533770012544:0@lo:400:kworker.0 00000100:00100000:1.0:1785787644.852993:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787644.853028:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905c5faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770013056:0@lo:400:kworker.0 00000100:00100000:1.0:1785787644.853048:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787644.853076:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1785787644.853081:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905c5fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8642023-9103-4dbf-85d1-f204189bc871:3336:1872533770012416:0@lo:400:kworker.0 00000100:00100000:1.0:1785787644.853104:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787644.853122:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905c5f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3336:1872533770012928:0@lo:400:kworker.0 00000100:00100000:1.0:1785787644.853140:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1785787644.853168:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1785787644.853173:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785787644.853259:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770012544 00000100:00100000:0.0:1785787644.853263:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770012544 00000100:00100000:0.0:1785787644.853295:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770012928 00000100:00100000:0.0:1785787644.853298:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770012928 00000100:00100000:0.0:1785787644.853323:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1785787644.853329:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3336:x1872533770012544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787644.853366:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3336:x1872533770012544:12345-0@lo:400:kworker.0 Request processed in 37us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787644.853372:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1785787644.853388:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1785787644.853394:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3336:x1872533770012928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787644.853433:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3336:x1872533770012928:12345-0@lo:400:kworker.0 Request processed in 39us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787644.853438:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:0.0:1785787644.853458:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785787644.853474:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905c5f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3336:1872533770012928:0@lo:400:kworker.0 00000100:00100000:0.0:1785787644.853505:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905c5f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3336:1872533770012544:0@lo:400:kworker.0 00000100:00100000:2.0:1785787644.853921:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770013056 00000100:00100000:2.0:1785787644.853926:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770013056 00000100:00100000:2.0:1785787644.853963:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1785787644.853970:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770013056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787644.854005:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770013056:12345-0@lo:400:kworker.0 Request processed in 36us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787644.854011:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1785787644.854220:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770012416 00000100:00100000:3.0:1785787644.854224:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770012416 00000100:00100000:3.0:1785787644.854255:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1785787644.854261:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905153a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+19:3336:x1872533770012416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787644.854290:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905153a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+19:3336:x1872533770012416:12345-0@lo:400:kworker.0 Request processed in 29us (1185us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787644.854295:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00080000:0.0:1785787644.856098:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785787644.856129:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905c5fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8642023-9103-4dbf-85d1-f204189bc871:3336:1872533770012416:0@lo:400:kworker.0 00000100:00100000:0.0:1785787644.856141:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905c5faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770013056:0@lo:400:kworker.0 00000100:00100000:1.0:1785787645.366158:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907712ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770013184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785787645.366221:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787645.366334:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770013184 00000100:00100000:3.0:1785787645.366341:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770013184 00000100:00100000:3.0:1785787645.366398:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1785787645.366406:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048782300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770013184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785787645.366438:0:6620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785787645.372168:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048782300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770013184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5752us (5936us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787645.372183:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1785787645.372362:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907712ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770013184:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1785787645.438596:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787646.451160:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787647.411539:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905c5f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770013312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785787647.411617:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787647.411708:0:6621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770013312 00000100:00100000:0.0:1785787647.411715:0:6621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770013312 00000100:00100000:0.0:1785787647.411774:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1785787647.411784:0:6621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770013312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785787647.411814:0:6621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785787647.411869:0:6621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770013312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787647.411875:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1785787647.411895:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1785787647.412269:0:3334:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91905c5f9880 x1872533770013312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787663 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787647.412285:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905c5f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770013312:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1785787647.488458:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1785787647.514571:0:7522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 79280304-55c6-4698-bfc3-29d14648ba45 00000020:00000080:0.0:1785787647.514579:0:7522:0:(genops.c:906:class_export_put()) final put ffff919045c78800/79280304-55c6-4698-bfc3-29d14648ba45 00000020:00000080:2.0:1785787647.514684:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff919045c78800/79280304-55c6-4698-bfc3-29d14648ba45 for lustre-OST0001 00000020:00000080:2.0:1785787647.514789:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff919045c7c000 for lustre-OST0001 00010000:00010000:0.0:1785787648.511059:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787649.532407:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787649.675088:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787649.675126:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787649.675154:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744806144 00000100:00100000:0.0:1785787649.675162:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787649.675163:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744806144 00000100:00100000:2.0:1785787649.675212:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 295 00000100:00100000:2.0:1785787649.675222:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051504c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2391:x1872533744806144:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:2.0:1785787649.675287:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051504c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2391:x1872533744806144:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 66us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787649.675295:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 295 00000100:00100000:0.0:1785787649.675701:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744806400 00000100:00100000:0.0:1785787649.675714:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744806400 00000100:00100000:0.0:1785787649.675758:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744806272 00000100:00100000:0.0:1785787649.675761:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744806272 00000100:00100000:0.0:1785787649.675782:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 149 00000100:00100000:0.0:1785787649.675789:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907712b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4ec65b7-e63e-42dc-becf-cba362002085+5:2391:x1872533744806400:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1785787649.675825:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907712b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4ec65b7-e63e-42dc-becf-cba362002085+5:2391:x1872533744806400:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 36us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787649.675857:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 149 00000100:00100000:2.0:1785787649.675863:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 150 00000100:00100000:2.0:1785787649.675871:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907712ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+5:2391:x1872533744806272:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:2.0:1785787649.675908:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907712ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+5:2391:x1872533744806272:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 37us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787649.675914:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 150 00000100:00080000:1.0:1785787649.676886:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785787649.973226:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fe16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3336:1872533770013568:0@lo:400:kworker.0 00000100:00100000:1.0:1785787649.973331:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787649.973386:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bd7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770014080:0@lo:400:kworker.0 00000100:00100000:1.0:1785787649.973411:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787649.973456:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1785787649.973463:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076ecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8642023-9103-4dbf-85d1-f204189bc871:3336:1872533770013440:0@lo:400:kworker.0 00000100:00100000:1.0:1785787649.973491:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787649.973512:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bd78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3336:1872533770013952:0@lo:400:kworker.0 00000100:00100000:1.0:1785787649.973532:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787649.973558:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fe14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3333:1872533770013696:0@lo:400:kworker.0 00000100:00100000:1.0:1785787649.973578:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787649.973595:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785787649.973600:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fe15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770013824:0@lo:400:kworker.0 00000100:00100000:1.0:1785787649.973622:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787649.973651:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770013568 00000100:00100000:1.0:1785787649.973658:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770013568 00000100:00100000:1.0:1785787649.973694:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770013952 00000100:00100000:1.0:1785787649.973697:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770013952 00000100:00100000:1.0:1785787649.973727:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770013696 00000100:00100000:1.0:1785787649.973730:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770013696 00000100:00100000:1.0:1785787649.973744:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1785787649.973758:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3336:x1872533770013568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787649.973847:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3336:x1872533770013568:12345-0@lo:400:kworker.0 Request processed in 68us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787649.973855:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1785787649.973869:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1785787649.973875:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3336:x1872533770013952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787649.973899:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3336:x1872533770013952:12345-0@lo:400:kworker.0 Request processed in 24us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787649.973904:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1785787649.973913:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1785787649.973918:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1872533770013696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787649.973941:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1872533770013696:12345-0@lo:400:kworker.0 Request processed in 23us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787649.973947:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1785787649.973960:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770014080 00000100:00100000:1.0:1785787649.973963:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770014080 00000100:00100000:1.0:1785787649.973984:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770013824 00000100:00100000:1.0:1785787649.973986:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770013824 00000100:00100000:1.0:1785787649.974002:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1785787649.974007:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770014080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787649.974031:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770014080:12345-0@lo:400:kworker.0 Request processed in 24us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787649.974036:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1785787649.974046:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1785787649.974051:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770013824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787649.974074:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770013824:12345-0@lo:400:kworker.0 Request processed in 24us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787649.974086:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1785787649.974102:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770013440 00000100:00100000:1.0:1785787649.974105:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770013440 00000100:00100000:1.0:1785787649.974125:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1785787649.974131:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051507050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+19:3336:x1872533770013440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787649.974156:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051507050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+19:3336:x1872533770013440:12345-0@lo:400:kworker.0 Request processed in 25us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787649.974161:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00080000:1.0:1785787649.974191:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785787649.974195:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785787649.974197:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1785787649.974227:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907fe15880 x1872533770013824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787649.974240:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fe15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770013824:0@lo:400:kworker.0 00000100:00100000:1.0:1785787649.974250:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fe14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3333:1872533770013696:0@lo:400:kworker.0 00000100:00100000:1.0:1785787649.974277:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076ecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8642023-9103-4dbf-85d1-f204189bc871:3336:1872533770013440:0@lo:400:kworker.0 00000100:00100000:1.0:1785787649.974285:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bd78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3336:1872533770013952:0@lo:400:kworker.0 00000100:00100000:1.0:1785787649.974292:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fe16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3336:1872533770013568:0@lo:400:kworker.0 00000100:00100000:1.0:1785787649.974299:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bd7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770014080:0@lo:400:kworker.0 00000100:00100000:2.0:1785787650.488014:0:3334:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785787650.488035:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770014208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785787650.488097:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787650.488197:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770014208 00000100:00100000:3.0:1785787650.488206:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770014208 00000100:00100000:3.0:1785787650.488247:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1785787650.488254:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076f18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770014208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785787650.488283:0:6620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785787650.488335:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076f18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770014208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787650.488341:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1785787650.488677:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770014208:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1785787650.547065:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1785787650.997089:0:11564:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1785787651.571160:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785787652.531264:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905c5f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770014336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785787652.531329:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787652.531544:0:8140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770014336 00000100:00100000:2.0:1785787652.531616:0:8140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770014336 00000100:00100000:2.0:1785787652.531673:0:8140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1785787652.531682:0:8140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905c5fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770014336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785787652.531725:0:8140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1785787652.531849:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785787652.531989:0:8140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905c5fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770014336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 308us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787652.531998:0:8140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:2.0:1785787652.532040:0:3334:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91905c5f9180 x1872533770014336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787668 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787652.532058:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905c5f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770014336:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1785787652.598608:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1785787652.810763:0:11729:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 16:07:31 (1785787651) 00010000:00010000:0.0:1785787653.625011:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787654.643030:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785787654.784582:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787654.784626:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787654.784780:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744806656 00000100:00100000:1.0:1785787654.784789:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744806656 00000100:00100000:1.0:1785787654.784888:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 154 00000100:00100000:1.0:1785787654.784899:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905c5f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+5:2388:x1872533744806656:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1785787654.784983:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905c5f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+5:2388:x1872533744806656:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 86us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787654.784991:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 154 00000100:00080000:0.0:1785787654.785152:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785787654.785317:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787654.788581:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744806784 00000100:00100000:1.0:1785787654.788593:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744806784 00000100:00080000:0.0:1785787654.788757:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785787654.789035:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 155 00000100:00100000:1.0:1785787654.789046:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905c5f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4ec65b7-e63e-42dc-becf-cba362002085+5:2388:x1872533744806784:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1785787654.789128:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905c5f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4ec65b7-e63e-42dc-becf-cba362002085+5:2388:x1872533744806784:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 86us (3812us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787654.789135:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 155 00000100:00100000:3.0:1785787654.794867:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744806528 00000100:00100000:3.0:1785787654.794880:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744806528 00000100:00100000:3.0:1785787654.794944:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 297 00000100:00100000:3.0:1785787654.794953:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051505c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2388:x1872533744806528:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1785787654.795088:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051505c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2388:x1872533744806528:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 135us (10459us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787654.795096:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 297 00000100:00100000:2.0:1785787654.884017:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787654.884124:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744806912 00000100:00100000:1.0:1785787654.884144:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744806912 00000100:00100000:1.0:1785787654.884213:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 32 00000100:00100000:1.0:1785787654.884223:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905c5fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+5:10256:x1872533744806912:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1785787654.884248:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787654.887184:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e846ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd31d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787654.887261:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e846f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787654.887276:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e846f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787654.887289:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e846f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785787654.887470:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1785787654.887480:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1785787654.887565:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e846f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787654.887593:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e846ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd31d expref: 7 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787654.887611:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e846f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd31d expref: 6 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787654.887620:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91905685f500) 00010000:00010000:1.0:1785787654.887623:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785787654.887626:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919043c0e400, rc 0) 00000100:00100000:1.0:1785787654.887694:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905c5fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+6:10256:x1872533744806912:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 3471us (3689us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787654.887702:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 32 00000100:00100000:0.0:1785787654.910335:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787654.910451:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744807040 00000100:00100000:1.0:1785787654.910464:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744807040 00000100:00100000:1.0:1785787654.910540:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 33 00000100:00100000:1.0:1785787654.910552:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+6:10257:x1872533744807040:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1785787654.910579:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787654.910606:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e846fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd324 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787654.910698:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e84702 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787654.910715:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e84702 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787654.910753:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e84702 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787654.910769:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84709 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787654.910776:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84709 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787654.910781:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84709 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787654.911280:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e800/0xe2c2ff68a6e84710 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787654.911291:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e800/0xe2c2ff68a6e84710 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787654.911299:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e800/0xe2c2ff68a6e84710 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785787654.911392:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1785787654.911396:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1785787654.911477:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e800/0xe2c2ff68a6e84710 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787654.911490:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e84702 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787654.911498:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e84702 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787654.911515:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e84702 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787654.911522:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0f400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787654.911527:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e84702 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787654.911535:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e84702 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787654.911549:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91905685f500) 00010000:00010000:1.0:1785787654.911552:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785787654.911557:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e84702 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787654.911564:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e84702 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787654.911580:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84709 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787654.911587:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84709 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787654.911594:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84709 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787654.911599:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0ec00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787654.911603:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84709 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787654.911619:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84709 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787654.911628:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff91905685f700) 00010000:00010000:1.0:1785787654.911631:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785787654.911634:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84709 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787654.911640:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84709 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787654.911686:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e846fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd324 expref: 8 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787654.911702:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e800/0xe2c2ff68a6e84710 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd324 expref: 7 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787654.911710:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91905685f200) 00010000:00010000:1.0:1785787654.911712:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785787654.911715:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919043c0e800, rc 0) 00000100:00100000:1.0:1785787654.911787:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+7:10257:x1872533744807040:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 1237us (1465us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787654.911795:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 33 00000100:00100000:0.0:1785787654.921292:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787654.921395:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744807296 00000100:00100000:2.0:1785787654.921408:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744807296 00000100:00100000:2.0:1785787654.921478:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 34 00000100:00100000:2.0:1785787654.921488:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+7:10257:x1872533744807296:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1785787654.921514:0:9295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787654.921540:0:9295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d600/0xe2c2ff68a6e84717 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd32b expref: -99 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787654.921630:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e8471e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787654.921648:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e8471e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787654.921662:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e8471e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787654.921884:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84725 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787654.921906:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84725 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787654.921918:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84725 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787654.923648:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c600/0xe2c2ff68a6e8472c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787654.923663:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c600/0xe2c2ff68a6e8472c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787654.923693:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c600/0xe2c2ff68a6e8472c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787654.923707:0:9295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1785787654.923917:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e8471e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787654.923925:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e8471e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787654.923932:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e8471e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787654.923938:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677cc00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787654.923943:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e8471e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787654.925358:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e8471e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787654.925373:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91905685f200) 00010000:00010000:2.0:1785787654.925376:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787654.925382:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e8471e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787654.925389:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e8471e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787654.925405:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84725 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787654.925411:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84725 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787654.925429:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84725 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787654.925435:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677da00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787654.925438:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84725 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787654.925444:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84725 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787654.925452:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9190481f9600) 00010000:00010000:2.0:1785787654.925455:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787654.925458:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84725 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787654.925463:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84725 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787654.928583:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d600/0xe2c2ff68a6e84717 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd32b expref: 10 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787654.928608:0:9295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c600/0xe2c2ff68a6e8472c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd32b expref: 9 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787654.928617:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9190481f9400) 00010000:00010000:2.0:1785787654.928620:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787654.928623:0:9295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677c600, rc 0) 00000100:00100000:2.0:1785787654.928711:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+9:10257:x1872533744807296:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 7223us (7431us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1785787654.928731:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 34 00000100:00100000:0.0:1785787654.933788:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787654.933935:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744807424 00000100:00100000:1.0:1785787654.933944:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744807424 00000100:00100000:1.0:1785787654.934002:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 35 00000100:00100000:1.0:1785787654.934011:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+9:10257:x1872533744807424:12345-192.168.203.53@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1785787654.934122:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+9:10257:x1872533744807424:12345-192.168.203.53@tcp:59:lhsmtool_posix.0 Request processed in 112us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787654.934130:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 35 00000100:00100000:0.0:1785787655.091106:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770014848:0@lo:400:kworker.0 00000100:00100000:0.0:1785787655.091180:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787655.091248:0:3334:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785787655.091254:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3334:1872533770014720:0@lo:400:kworker.0 00000100:00100000:0.0:1785787655.091286:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787655.091319:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770014848 00000100:00100000:0.0:1785787655.091326:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770014848 00000100:00100000:0.0:1785787655.091372:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1785787655.091381:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770014848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787655.091440:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770014848:12345-0@lo:400:kworker.0 Request processed in 61us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787655.091447:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1785787655.091464:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1785787655.091487:0:3334:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907764c380 x1872533770014848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785787671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787655.091499:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770014848:0@lo:400:kworker.0 00000100:00100000:2.0:1785787655.091790:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8642023-9103-4dbf-85d1-f204189bc871:3335:1872533770014464:0@lo:400:kworker.0 00000100:00100000:2.0:1785787655.091824:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787655.091866:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3335:1872533770014976:0@lo:400:kworker.0 00000100:00100000:2.0:1785787655.091886:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787655.091902:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1785787655.091907:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3335:1872533770014592:0@lo:400:kworker.0 00000100:00100000:2.0:1785787655.091964:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787655.091978:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770015104:0@lo:400:kworker.0 00000100:00100000:2.0:1785787655.091995:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787655.092016:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770014720 00000100:00100000:2.0:1785787655.092019:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770014720 00000100:00100000:2.0:1785787655.092044:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770014976 00000100:00100000:2.0:1785787655.092047:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770014976 00000100:00100000:2.0:1785787655.092072:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770014592 00000100:00100000:2.0:1785787655.092074:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770014592 00000100:00100000:2.0:1785787655.092085:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1785787655.092091:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3334:x1872533770014720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787655.092122:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3334:x1872533770014720:12345-0@lo:400:kworker.0 Request processed in 31us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787655.092128:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1785787655.092140:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1785787655.092145:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905c5fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3335:x1872533770014976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787655.092170:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905c5fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3335:x1872533770014976:12345-0@lo:400:kworker.0 Request processed in 25us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787655.092185:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1785787655.092196:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1785787655.092201:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905c5fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3335:x1872533770014592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787655.092224:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905c5fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3335:x1872533770014592:12345-0@lo:400:kworker.0 Request processed in 23us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787655.092229:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1785787655.092250:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3335:1872533770014592:0@lo:400:kworker.0 00000100:00100000:3.0:1785787655.092343:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770014464 00000100:00100000:3.0:1785787655.092347:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770014464 00000100:00100000:3.0:1785787655.092370:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1785787655.092376:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051505450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+19:3335:x1872533770014464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787655.092406:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051505450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+19:3335:x1872533770014464:12345-0@lo:400:kworker.0 Request processed in 31us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787655.092412:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1785787655.092553:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3335:1872533770014976:0@lo:400:kworker.0 00000100:00100000:2.0:1785787655.092573:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8642023-9103-4dbf-85d1-f204189bc871:3335:1872533770014464:0@lo:400:kworker.0 00000100:00100000:1.0:1785787655.092800:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770015104 00000100:00100000:1.0:1785787655.092804:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770015104 00000100:00100000:1.0:1785787655.092864:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1785787655.092871:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905c5f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533770015104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787655.092909:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905c5f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533770015104:12345-0@lo:400:kworker.0 Request processed in 39us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787655.092915:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1785787655.092995:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770015104:0@lo:400:kworker.0 00000040:00080000:0.0:1785787655.097077:0:11564:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:0.0:1785787655.097148:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785787655.097154:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785787655.097196:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3334:1872533770014720:0@lo:400:kworker.0 00000100:00100000:0.0:1785787655.608751:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770015232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785787655.608815:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787655.608896:0:6621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770015232 00000100:00100000:0.0:1785787655.608903:0:6621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770015232 00000100:00100000:0.0:1785787655.608948:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1785787655.608956:0:6621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770015232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785787655.608987:0:6621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785787655.609026:0:6621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770015232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787655.609033:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1785787655.609071:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770015232:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785787655.668743:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787656.690953:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787657.221570:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787657.221722:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744807552 00000100:00100000:2.0:1785787657.221731:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744807552 00000100:00100000:2.0:1785787657.221796:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 36 00000100:00100000:2.0:1785787657.221805:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+9:10299:x1872533744807552:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:2.0:1785787657.221824:0:9295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787657.221860:0:9295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e8473a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd332 expref: -99 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.221911:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e84741 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.221923:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e84741 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.221934:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e84741 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.221956:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84748 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.221962:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84748 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.221977:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84748 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.222199:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e84741 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.222207:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e84741 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.222214:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e84741 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.222220:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677c800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787657.222225:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e84741 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.222232:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e84741 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.222244:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91905685f500) 00010000:00010000:2.0:1785787657.222247:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787657.222251:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e84741 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.222257:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e84741 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.222272:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84748 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.222277:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84748 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.222281:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84748 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.222285:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677d800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787657.222287:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84748 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.222292:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84748 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.222297:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9190481f9600) 00010000:00010000:2.0:1785787657.222299:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787657.222301:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84748 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.222306:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84748 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.222338:0:9295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e8473a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd332 expref: 10 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.222347:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91905685f500) 00010000:00010000:2.0:1785787657.222349:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787657.222356:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e8473a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd332 expref: 10 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.222364:0:9295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677ca00, rc 0) 00000100:00100000:2.0:1785787657.222448:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+9:10299:x1872533744807552:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 644us (887us total) trans 0 rc 301/301 00000100:00100000:2.0:1785787657.222454:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 36 00000100:00080000:0.0:1785787657.222883:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785787657.237273:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787657.237318:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744807808 00000100:00100000:0.0:1785787657.237326:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744807808 00000100:00100000:0.0:1785787657.237368:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 37 00000100:00100000:0.0:1785787657.237376:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+9:10299:x1872533744807808:12345-192.168.203.53@tcp:36:lfs.0 00010000:00010000:0.0:1785787657.237428:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785787657.237454:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e846f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd31d expref: 9 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787657.237475:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91905685f500) 00010000:00010000:0.0:1785787657.237486:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785787657.237893:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919050679600/0xe2c2ff68a6e8474f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787657.237906:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919050679600/0xe2c2ff68a6e8474f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787657.237915:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919050679600/0xe2c2ff68a6e8474f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787657.237926:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919050678a00/0xe2c2ff68a6e84756 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787657.237934:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919050678a00/0xe2c2ff68a6e84756 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787657.237940:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919050678a00/0xe2c2ff68a6e84756 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785787657.241253:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1785787657.241271:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919050679600/0xe2c2ff68a6e8474f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787657.241288:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919050679600/0xe2c2ff68a6e8474f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787657.241294:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919050679600/0xe2c2ff68a6e8474f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787657.241299:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919050679600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1785787657.241304:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919050679600/0xe2c2ff68a6e8474f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787657.241310:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919050679600/0xe2c2ff68a6e8474f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787657.241322:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919059e3ed00) 00010000:00010000:0.0:1785787657.241325:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785787657.241329:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919050679600/0xe2c2ff68a6e8474f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787657.241333:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919050679600/0xe2c2ff68a6e8474f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785787657.241348:0:5821:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009c2d20ec reply state 0000000089336ab5 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff919050678a00/0xe2c2ff68a6e84756 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787657.241356:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785787657.241487:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+10:10299:x1872533744807808:12345-192.168.203.53@tcp:36:lfs.0 Request processed in 4108us (4218us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1785787657.241495:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 37 00010000:00010000:1.0:1785787657.260102:0:3320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919050678a00/0xe2c2ff68a6e84756 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787657.260120:0:3320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919050678a00/0xe2c2ff68a6e84756 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787657.260128:0:3320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919050678a00/0xe2c2ff68a6e84756 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787657.260134:0:3320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919050678a00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787657.260139:0:3320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919050678a00/0xe2c2ff68a6e84756 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787657.260146:0:3320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919050678a00/0xe2c2ff68a6e84756 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787657.260162:0:3320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff919059e3ea00) 00010000:00010000:1.0:1785787657.260165:0:3320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785787657.260169:0:3320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919050678a00/0xe2c2ff68a6e84756 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787657.260182:0:3320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919050678a00/0xe2c2ff68a6e84756 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787657.392089:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787657.392215:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744807936 00000100:00100000:2.0:1785787657.392224:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744807936 00000100:00100000:2.0:1785787657.392279:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 38 00000100:00100000:2.0:1785787657.392287:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+9:10307:x1872533744807936:12345-192.168.203.53@tcp:101:lctl.0 00010000:00010000:2.0:1785787657.392307:0:9295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787657.392327:0:9295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e8475d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd339 expref: -99 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.392383:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e84764 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.392397:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e84764 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.392408:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e84764 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787657.392462:0:9295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1785787657.392465:0:9295:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1785787657.392496:0:9295:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e84764 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.392516:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e8475d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd339 expref: 11 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.392544:0:9295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e84764 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd339 expref: 10 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.392552:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9190481f9600) 00010000:00010000:2.0:1785787657.392554:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785787657.392557:0:9295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677c800, rc 0) 00000100:00100000:2.0:1785787657.392613:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+10:10307:x1872533744807936:12345-192.168.203.53@tcp:101:lctl.0 Request processed in 326us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787657.392619:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 38 00000100:00100000:0.0:1785787657.469498:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787657.469623:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744808064 00000100:00100000:2.0:1785787657.469632:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744808064 00000100:00100000:2.0:1785787657.469695:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 39 00000100:00100000:2.0:1785787657.469704:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+10:10313:x1872533744808064:12345-192.168.203.53@tcp:101:bash.0 00010000:00010000:2.0:1785787657.469722:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787657.469740:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e8476b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd340 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.469796:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e84772 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.469810:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e84772 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.469820:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e84772 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.469879:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84779 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.469893:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84779 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.469900:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84779 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.469994:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d400/0xe2c2ff68a6e84780 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.470001:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d400/0xe2c2ff68a6e84780 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.470007:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d400/0xe2c2ff68a6e84780 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787657.470032:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1785787657.470035:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785787657.470065:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d400/0xe2c2ff68a6e84780 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.470075:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e84772 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.470080:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e84772 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.470085:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e84772 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.470090:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677ce00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787657.470093:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e84772 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.470279:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e84772 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.470292:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9190481f9600) 00010000:00010000:2.0:1785787657.470294:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787657.470297:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e84772 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.470302:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e84772 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.470313:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84779 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.470318:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84779 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.470323:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84779 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.470327:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677d000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787657.470329:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84779 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.470333:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84779 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.470338:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9190481f9200) 00010000:00010000:2.0:1785787657.470340:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787657.470343:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84779 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.470358:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84779 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.470386:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e8476b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd340 expref: 12 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.470397:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d400/0xe2c2ff68a6e84780 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd340 expref: 11 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.470404:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9190481f9e00) 00010000:00010000:2.0:1785787657.470406:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1785787657.470408:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677d400, rc 0) 00000100:00100000:2.0:1785787657.470499:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+11:10313:x1872533744808064:12345-192.168.203.53@tcp:101:bash.0 Request processed in 795us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787657.470506:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 39 00000100:00100000:0.0:1785787657.482296:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787657.486394:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744808320 00000100:00100000:2.0:1785787657.486408:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744808320 00000100:00100000:2.0:1785787657.486525:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 40 00000100:00100000:2.0:1785787657.486535:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+11:10313:x1872533744808320:12345-192.168.203.53@tcp:101:bash.0 00010000:00010000:2.0:1785787657.486554:0:9295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787657.486573:0:9295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84787 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd347 expref: -99 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.486698:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e8478e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.486712:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e8478e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.486735:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e8478e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.486789:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e84795 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.486797:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e84795 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.486804:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e84795 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785787657.490361:0:9295:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1785787657.491405:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e8479c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.491423:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e8479c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.491434:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e8479c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.491467:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e8478e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.491473:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e8478e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.491480:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e8478e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.491486:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677d000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787657.491495:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e8478e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.491502:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e8478e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.492245:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9190481f9e00) 00010000:00010000:2.0:1785787657.492250:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787657.492257:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e8478e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.492263:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e8478e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785787657.492279:0:9295:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000098098ecd reply state 000000007ea07d73 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e84795 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787657.492287:0:9295:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785787657.492324:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84787 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd347 expref: 14 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.492338:0:9295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e8479c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd347 expref: 13 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.492345:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9190481f9300) 00010000:00010000:2.0:1785787657.492348:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785787657.492350:0:9295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677dc00, rc 0) 00000100:00100000:2.0:1785787657.492421:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+14:10313:x1872533744808320:12345-192.168.203.53@tcp:101:bash.0 Request processed in 5887us (10132us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1785787657.492430:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 40 00010000:00010000:3.0:1785787657.494251:0:3319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e84795 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787657.494263:0:3319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e84795 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787657.494269:0:3319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e84795 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787657.494275:0:3319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677ce00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787657.494279:0:3319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e84795 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787657.494296:0:3319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e84795 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787657.494308:0:3319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9190481f9200) 00010000:00010000:3.0:1785787657.494311:0:3319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787657.494316:0:3319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e84795 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787657.494322:0:3319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e84795 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787657.496370:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787657.498624:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744808448 00000100:00100000:1.0:1785787657.498636:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744808448 00000100:00100000:1.0:1785787657.498686:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 20 00000100:00100000:1.0:1785787657.498693:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2387:x1872533744808448:12345-192.168.203.53@tcp:8:bash.0 00010000:00080000:1.0:1785787657.498720:0:9394:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 79280304-55c6-4698-bfc3-29d14648ba45@192.168.203.53@tcp t0 exp 0000000000000000 cur 444 last 0 00000020:00000080:1.0:1785787657.498749:0:9394:0:(genops.c:1406:class_connect()) connect: client 79280304-55c6-4698-bfc3-29d14648ba45, cookie 0xe2c2ff68a6e847aa 00002000:00100000:1.0:1785787657.498759:0:9394:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 79280304-55c6-4698-bfc3-29d14648ba45/ffff919055565000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113801 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1785787657.498779:0:9394:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1785787657.499004:0:9394:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1785787657.499029:0:9394:0:(import.c:65:import_set_state_nolock()) ffff9190454be800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1785787657.499088:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:79280304-55c6-4698-bfc3-29d14648ba45+6:2387:x1872533744808448:12345-192.168.203.53@tcp:8:bash.0 Request processed in 394us (2725us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787657.499095:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 20 00000100:00100000:0.0:1785787657.507770:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787657.515270:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744808576 00000100:00100000:1.0:1785787657.515283:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744808576 00000100:00080000:0.0:1785787657.516240:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785787657.520296:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 21 00000100:00100000:1.0:1785787657.520319:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:79280304-55c6-4698-bfc3-29d14648ba45+6:0:x1872533744808576:12345-192.168.203.53@tcp:101:bash.0 00010000:00010000:1.0:1785787657.520340:0:6619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787657.520363:0:6619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0e1d39e/0xe2c2ff68a6e847b1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd34e expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1785787657.520387:0:6619:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785787657.520419:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1785787657.520424:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785787657.520434:0:6619:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0e1d39e/0xe2c2ff68a6e847b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd34e expref: 7 pid: 6619 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787657.520454:0:6619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c0e1d39e/0xe2c2ff68a6e847b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd34e expref: 7 pid: 6619 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787657.520466:0:6619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919043c0ea00, rc 0) 00000100:00100000:1.0:1785787657.521658:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:79280304-55c6-4698-bfc3-29d14648ba45+7:0:x1872533744808576:12345-192.168.203.53@tcp:101:bash.0 Request processed in 1339us (13884us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787657.521667:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 21 00000100:00100000:0.0:1785787657.539352:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787657.539432:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744808704 00000100:00100000:1.0:1785787657.539441:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744808704 00000100:00100000:1.0:1785787657.539489:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 22 00000100:00100000:1.0:1785787657.539497:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:79280304-55c6-4698-bfc3-29d14648ba45+7:10313:x1872533744808704:12345-192.168.203.53@tcp:101:bash.0 00010000:00010000:1.0:1785787657.539521:0:6617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787657.539537:0:6617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa3b8c89/0xe2c2ff68a6e847b8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd355 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787657.539563:0:6617:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c0e1d39e/0xe2c2ff68a6e847b1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd34e expref: 8 pid: 6619 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787657.539571:0:6617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785787657.539574:0:6617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785787657.539579:0:6617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa3b8c89/0xe2c2ff68a6e847b8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd355 expref: 8 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787657.539618:0:6617:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c0e1d39e/0xe2c2ff68a6e847b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd34e expref: 8 pid: 6619 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787657.539630:0:6617:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c0e1d39e/0xe2c2ff68a6e847b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd34e expref: 8 pid: 6619 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787657.539644:0:6617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bd7a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6617:1872533770015360:192.168.203.53@tcp:104: 00000100:00100000:1.0:1785787657.539742:0:6617:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190515b7600 going to sleep for 11 seconds 00000100:00100000:1.0:1785787657.548024:0:6617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bd7a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6617:1872533770015360:192.168.203.53@tcp:104: 00010000:00010000:1.0:1785787657.548058:0:6617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa3b8c89/0xe2c2ff68a6e847b8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd355 expref: 8 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787657.548076:0:6617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919043c0ec00, rc 0) 00000100:00100000:1.0:1785787657.548263:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:79280304-55c6-4698-bfc3-29d14648ba45+8:10313:x1872533744808704:12345-192.168.203.53@tcp:101:bash.0 Request processed in 8766us (8918us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787657.548271:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 22 00000100:00100000:3.0:1785787657.549624:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787657.549690:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744808832 00000100:00100000:0.0:1785787657.549697:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744808832 00010000:00010000:0.0:1785787657.549726:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c0e1d39e/0xe2c2ff68a6e847b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd34e expref: 8 pid: 6619 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787657.549755:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 35 00000100:00100000:0.0:1785787657.549763:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79280304-55c6-4698-bfc3-29d14648ba45+8:2389:x1872533744808832:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785787657.549775:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785787657.549793:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c0e1d39e/0xe2c2ff68a6e847b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd34e expref: 8 pid: 6619 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787657.549806:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c0e1d39e/0xe2c2ff68a6e847b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd34e expref: 8 pid: 6619 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787657.549871:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0e1d39e/0xe2c2ff68a6e847b1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd34e expref: 8 pid: 6619 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787657.549886:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785787657.549890:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785787657.549897:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa3b8c89/0xe2c2ff68a6e847b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd355 expref: 7 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787657.549924:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa3b8c89/0xe2c2ff68a6e847b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd355 expref: 7 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787657.549957:0:5807:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fa3b8c89/0xe2c2ff68a6e847b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd355 expref: 7 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787657.549971:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5807:1872533770015488:192.168.203.53@tcp:105: 00000100:00100000:0.0:1785787657.550035:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff919048612180 going to sleep for 11 seconds 00000100:00100000:3.0:1785787657.553273:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5807:1872533770015488:192.168.203.53@tcp:105: 00010000:00010000:3.0:1785787657.553294:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787657.553374:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79280304-55c6-4698-bfc3-29d14648ba45+7:2389:x1872533744808832:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 3610us (3751us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787657.553383:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 35 00000100:00100000:0.0:1785787657.554235:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787657.554349:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744809088 00000100:00100000:2.0:1785787657.554355:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744809088 00000100:00100000:2.0:1785787657.554402:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 6 00000100:00100000:2.0:1785787657.554409:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+13:10313:x1872533744809088:12345-192.168.203.53@tcp:35:bash.0 00000100:00100000:2.0:1785787657.560390:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+14:10313:x1872533744809088:12345-192.168.203.53@tcp:35:bash.0 Request processed in 5964us (7269us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1785787657.560404:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 6 00000100:00100000:3.0:1785787657.653417:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bd7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770015616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785787657.653503:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787657.653753:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770015616 00000100:00100000:1.0:1785787657.653761:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770015616 00000100:00100000:1.0:1785787657.653823:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1785787657.653852:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770015616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785787657.653875:0:6620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785787657.653916:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770015616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787657.653923:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1785787657.654030:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785787657.654071:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bd7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770015616:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785787657.663139:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787657.663495:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744809344 00000100:00100000:3.0:1785787657.663504:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744809344 00000100:00100000:3.0:1785787657.668685:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 41 00000100:00100000:3.0:1785787657.668703:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+14:10323:x1872533744809344:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:3.0:1785787657.668737:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787657.668765:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e847bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd35c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785787657.669073:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1785787657.669346:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e847bf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd35c expref: 16 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787657.669360:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9190481f9600) 00010000:00010000:3.0:1785787657.669362:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785787657.669366:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e847bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd35c expref: 16 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787657.669376:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f903800, rc 0) 00000100:00100000:3.0:1785787657.670955:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+15:10323:x1872533744809344:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 2252us (7815us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1785787657.670965:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 41 00000100:00100000:3.0:1785787657.683950:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787657.684657:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744809600 00000100:00100000:2.0:1785787657.684666:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744809600 00000100:00100000:2.0:1785787657.684712:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 7 00000100:00100000:2.0:1785787657.684720:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+15:10323:x1872533744809600:12345-192.168.203.53@tcp:35:lfs.0 00000100:00100000:2.0:1785787657.685099:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+16:10323:x1872533744809600:12345-192.168.203.53@tcp:35:lfs.0 Request processed in 378us (1155us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1785787657.686721:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 7 00010000:00010000:3.0:1785787657.715338:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1785787657.740913:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000001:00080000:2.0:1785787657.741719:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967312 is committed 00000100:00100000:2.0:1785787657.789366:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787657.789470:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744809728 00000100:00100000:1.0:1785787657.789478:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744809728 00000100:00100000:1.0:1785787657.789530:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 42 00000100:00100000:1.0:1785787657.789538:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905c5f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+12:10329:x1872533744809728:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:1.0:1785787657.789563:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787657.789582:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e847cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd363 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787657.789641:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e847d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787657.789663:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e847d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787657.789675:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e847d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785787657.790049:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1785787657.790053:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1785787657.790888:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e847d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787657.790916:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e847cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd363 expref: 14 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787657.790932:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e847d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd363 expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787657.790939:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9190481f9e00) 00010000:00010000:1.0:1785787657.790942:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785787657.790951:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919043c0ea00, rc 0) 00000100:00100000:1.0:1785787657.791048:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905c5f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+13:10329:x1872533744809728:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 1510us (1688us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787657.791055:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 42 00000100:00100000:2.0:1785787657.801019:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787657.803992:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744809984 00000100:00100000:0.0:1785787657.804004:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744809984 00000100:00100000:0.0:1785787657.804182:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 43 00000100:00100000:0.0:1785787657.804192:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905c5faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+13:10329:x1872533744809984:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:0.0:1785787657.804210:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787657.804229:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919050679200/0xe2c2ff68a6e847db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd36a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787657.804310:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919050678800/0xe2c2ff68a6e847e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787657.804321:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919050678800/0xe2c2ff68a6e847e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787657.804331:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919050678800/0xe2c2ff68a6e847e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785787657.804357:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1785787657.804471:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919050679200/0xe2c2ff68a6e847db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd36a expref: 16 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787657.804489:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919050678800/0xe2c2ff68a6e847e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd36a expref: 15 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787657.804498:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9190481f9300) 00010000:00010000:0.0:1785787657.804501:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785787657.804504:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919050678800, rc 0) 00000100:00100000:0.0:1785787657.804580:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905c5faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+15:10329:x1872533744809984:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 391us (3570us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1785787657.804586:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 43 00000100:00100000:3.0:1785787657.815281:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787657.815333:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787657.815407:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744810240 00000100:00100000:2.0:1785787657.815416:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744810240 00000100:00100000:2.0:1785787657.815475:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 44 00000100:00100000:2.0:1785787657.815483:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+15:10329:x1872533744810240:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:2.0:1785787657.815506:0:9295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787657.815535:0:9295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e847f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd371 expref: -99 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.815625:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e847f7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.815657:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e847f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.815668:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e847f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787657.815682:0:9295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1785787657.815789:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e847f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd371 expref: 18 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.815807:0:9295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e847f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd371 expref: 17 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.815816:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9190481f9300) 00010000:00010000:2.0:1785787657.815819:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1785787657.815823:0:9295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677d800, rc 0) 00000100:00100000:2.0:1785787657.815893:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+17:10329:x1872533744810240:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 410us (620us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1785787657.815899:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 44 00000100:00100000:0.0:1785787657.816465:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744810368 00000100:00100000:0.0:1785787657.816472:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744810368 00000100:00100000:2.0:1785787657.822409:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787657.822491:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744810496 00000100:00100000:3.0:1785787657.822499:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744810496 00000100:00100000:3.0:1785787657.822555:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 23 00000100:00100000:3.0:1785787657.822564:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905c5fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+7:2389:x1872533744810496:12345-192.168.203.53@tcp:1:lfs.0 00010000:00010000:3.0:1785787657.822602:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943edf86/0xe2c2ff68a6e84805 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787657.822619:0:6618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa3b8c89/0xe2c2ff68a6e847b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd355 expref: 7 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787657.822639:0:6618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1785787657.822643:0:6618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1785787657.822655:0:6618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943edf86/0xe2c2ff68a6e84805 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787657.822690:0:6618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fa3b8c89/0xe2c2ff68a6e847b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd355 expref: 7 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787657.822704:0:6618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fa3b8c89/0xe2c2ff68a6e847b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd355 expref: 7 pid: 6617 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787657.822723:0:6618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905faf7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6618:1872533770015744:192.168.203.53@tcp:104: 00000100:00100000:3.0:1785787657.822822:0:6618:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190584e4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1785787657.823316:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2 00000100:00100000:1.0:1785787657.823326:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79280304-55c6-4698-bfc3-29d14648ba45+17:2389:x1872533744810368:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785787657.823338:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785787657.823357:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919050678800/0xe2c2ff68a6e847e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd36a expref: 17 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787657.823372:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9190481f9300) 00010000:00010000:1.0:1785787657.823376:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785787657.823419:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79280304-55c6-4698-bfc3-29d14648ba45+16:2389:x1872533744810368:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 94us (8084us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787657.823426:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2 00000100:00100000:3.0:1785787657.827202:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787657.827235:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744810624 00000100:00100000:3.0:1785787657.827242:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744810624 00002000:00100000:3.0:1785787657.827279:0:6622:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff91905faf4000 x1872533744810624/t0(0) o4->79280304-55c6-4698-bfc3-29d14648ba45@192.168.203.53@tcp:513/0 lens 504/0 e 0 to 0 dl 1785787668 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785787657.827289:0:6622:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91905faf4000 with x1872533744810624 ext(0->12) 00010000:00010000:3.0:1785787657.827297:0:6622:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000fa3b8c89/0xe2c2ff68a6e847b8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd355 expref: 8 pid: 6617 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787657.827310:0:6622:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000fa3b8c89/0xe2c2ff68a6e847b8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd355 expref: 8 pid: 6617 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785787657.827332:0:6622:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff91905faf4000 00000100:00100000:3.0:1785787657.827352:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 0 00000100:00100000:3.0:1785787657.827359:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:79280304-55c6-4698-bfc3-29d14648ba45+8:2390:x1872533744810624:12345-192.168.203.53@tcp:4:lfs.0 00000100:00100000:0.0:1785787657.827738:0:6618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905faf7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6618:1872533770015744:192.168.203.53@tcp:104: 00010000:00010000:0.0:1785787657.827757:0:6618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000943edf86/0xe2c2ff68a6e84805 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1785787657.849817:0:6642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 79280304-55c6-4698-bfc3-29d14648ba45 00000100:00100000:0.0:1785787657.854018:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:79280304-55c6-4698-bfc3-29d14648ba45+9:2390:x1872533744810624:12345-192.168.203.53@tcp:4:lfs.0 Request processed in 26651us (26815us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1785787657.854033:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 0 00002000:00100000:0.0:1785787657.854044:0:6622:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff91905faf4000 x1872533744810624/t4294967299(0) o4->79280304-55c6-4698-bfc3-29d14648ba45@192.168.203.53@tcp:513/0 lens 504/448 e 0 to 0 dl 1785787668 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785787657.854053:0:6622:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91905faf4000 with x1872533744810624 ext(0->12) 00010000:00010000:0.0:1785787657.854079:0:6622:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000fa3b8c89/0xe2c2ff68a6e847b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd355 expref: 9 pid: 6617 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787657.854097:0:6622:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000fa3b8c89/0xe2c2ff68a6e847b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd355 expref: 9 pid: 6617 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785787657.855236:0:6622:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff91905faf4000 00000100:00100000:3.0:1785787657.864443:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787657.868010:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744810752 00000100:00100000:0.0:1785787657.868023:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744810752 00010000:00010000:0.0:1785787657.870918:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fa3b8c89/0xe2c2ff68a6e847b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd355 expref: 9 pid: 6617 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787657.870973:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 36 00000100:00100000:0.0:1785787657.870984:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79280304-55c6-4698-bfc3-29d14648ba45+9:2391:x1872533744810752:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785787657.871000:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1785787657.871019:0:5806:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1785787657.871022:0:5806:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1785787657 00002000:00010000:0.0:1785787657.871024:0:5806:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1785787658 00002000:00010000:0.0:1785787657.871026:0:5806:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1785787657 00010000:00010000:0.0:1785787657.871033:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fa3b8c89/0xe2c2ff68a6e847b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd355 expref: 9 pid: 6617 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787657.871047:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fa3b8c89/0xe2c2ff68a6e847b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd355 expref: 9 pid: 6617 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787657.871069:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa3b8c89/0xe2c2ff68a6e847b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd355 expref: 9 pid: 6617 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787657.871118:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1785787657.871123:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1785787657.871128:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000943edf86/0xe2c2ff68a6e84805 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787657.871138:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943edf86/0xe2c2ff68a6e84805 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787657.871168:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785787657.871224:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79280304-55c6-4698-bfc3-29d14648ba45+8:2391:x1872533744810752:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 241us (6789us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787657.871231:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 36 00010000:00010000:2.0:1785787657.871303:0:6618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000943edf86/0xe2c2ff68a6e84805 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.871313:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943edf86/0xe2c2ff68a6e84805 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.871347:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943edf86/0xe2c2ff68a6e84805 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.871354:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000943edf86/0xe2c2ff68a6e84805 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.871361:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000943edf86/0xe2c2ff68a6e84805 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.871366:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903800 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785787657.871370:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000943edf86/0xe2c2ff68a6e84805 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.871376:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000943edf86/0xe2c2ff68a6e84805 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.871386:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000943edf86/0xe2c2ff68a6e84805 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.871393:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000943edf86/0xe2c2ff68a6e84805 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787657.871440:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905c5fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+7:2389:x1872533744810496:12345-192.168.203.53@tcp:1:lfs.0 Request processed in 48876us (49038us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787657.871447:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 23 00000100:00100000:3.0:1785787657.881872:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787657.881948:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744811008 00000100:00100000:2.0:1785787657.881958:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744811008 00000100:00100000:2.0:1785787657.882026:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 8 00000100:00100000:2.0:1785787657.882035:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+16:10329:x1872533744811008:12345-192.168.203.53@tcp:35:lfs.0 00000004:00010000:2.0:1785787657.882089:0:5823:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e847f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd371 expref: 16 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785787657.882380:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1785787657.882435:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1785787657.883157:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1785787657.883212:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e8480c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.883227:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e8479c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd347 expref: 20 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.883235:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e8480c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.883265:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e8479c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd347 expref: 20 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.883277:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e8479c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd347 expref: 20 pid: 9295 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787657.883288:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905c5f8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5823:1872533770015872:192.168.203.53@tcp:104: 00000100:00100000:2.0:1785787657.883378:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set ffff919076ddfa80 going to sleep for 11 seconds 00000100:00100000:2.0:1785787657.885494:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905c5f8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5823:1872533770015872:192.168.203.53@tcp:104: 00010000:00010000:2.0:1785787657.885562:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e8480c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787657.904135:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787657.904223:0:11051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744811136 00000100:00100000:2.0:1785787657.904231:0:11051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744811136 00010000:00010000:2.0:1785787657.904266:0:11051:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e8479c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd347 expref: 21 pid: 9295 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787657.904303:0:11051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 37 00000100:00100000:2.0:1785787657.904312:0:11051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ec8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79280304-55c6-4698-bfc3-29d14648ba45+21:2390:x1872533744811136:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785787657.904324:0:11051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785787657.904329:0:11051:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e8479c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd347 expref: 21 pid: 9295 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.904340:0:11051:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e8479c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd347 expref: 21 pid: 9295 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.904358:0:11051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e8479c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd347 expref: 21 pid: 9295 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.904372:0:11051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9190481f9300) 00010000:00010000:2.0:1785787657.904376:0:11051:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e8480c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.904383:0:11051:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e8480c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.904389:0:11051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e8480c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787657.904417:0:11051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785787657.904571:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e8480c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787657.904579:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e8480c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785787657.904704:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1785787657.904924:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1785787657.905025:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076ecaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5823:1872533770016000:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1785787657.905064:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787657.905084:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set ffff91904830bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1785787657.905143:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770016000 00000100:00100000:1.0:1785787657.905148:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770016000 00000100:00100000:1.0:1785787657.905182:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1785787657.905189:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5823:x1872533770016000:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1785787657.905259:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5823:x1872533770016000:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 69us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787657.905266:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1785787657.905301:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076ecaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5823:1872533770016000:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1785787657.905913:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1785787657.905960:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bd78e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5823:1872533770016128:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1785787657.905987:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787657.906009:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set ffff91904689b840 going to sleep for 11 seconds 00000100:00100000:1.0:1785787657.906023:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770016128 00000100:00100000:1.0:1785787657.906027:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770016128 00000100:00100000:1.0:1785787657.906047:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1785787657.906053:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5823:x1872533770016128:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1785787657.906180:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5823:x1872533770016128:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 127us (192us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1785787657.906188:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1785787657.906214:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bd78e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5823:1872533770016128:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1785787657.906247:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1785787657.906275:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e8480c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787657.906285:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e8480c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787657.906291:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e8480c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787657.906297:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677d000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787657.906301:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e8480c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787657.906309:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e8480c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787657.906323:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9190481f9300) 00010000:00010000:1.0:1785787657.906327:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1785787657.906331:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e8480c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787657.906347:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e8480c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785787657.906488:0:5823:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1785787657.906690:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1785787657.906700:0:5823:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 445150871653ns, next at 446150869729ns, rc = 0 00000001:00080000:1.0:1785787657.906708:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1785787657.906737:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9190481f9300) 00010000:00010000:1.0:1785787657.906740:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1785787657.906747:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e847f7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd371 expref: 25 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787657.906878:0:11051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ec8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79280304-55c6-4698-bfc3-29d14648ba45+24:2390:x1872533744811136:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 2565us (2749us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787657.906888:0:11051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 37 00000100:00100000:1.0:1785787657.907328:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+23:10329:x1872533744811008:12345-192.168.203.53@tcp:35:lfs.0 Request processed in 25294us (25462us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1785787657.907337:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 8 00000020:00080000:1.0:1785787657.907341:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1785787657.917584:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787657.917737:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744811264 00000100:00100000:1.0:1785787657.917746:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744811264 00000100:00100000:1.0:1785787657.917811:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 45 00000100:00100000:1.0:1785787657.917821:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+23:10329:x1872533744811264:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:1.0:1785787657.917869:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787657.917891:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e84813 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd378 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787657.917949:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e84813 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd378 expref: 24 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787657.917984:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e84813 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd378 expref: 24 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787657.918006:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91905685f400) 00010000:00010000:1.0:1785787657.918009:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1785787657.918013:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919043c0f400, rc 0) 00000100:00100000:1.0:1785787657.918068:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+24:10329:x1872533744811264:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 249us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787657.918074:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 45 00000100:00100000:2.0:1785787657.933444:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787657.933536:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744811520 00000100:00100000:3.0:1785787657.933547:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744811520 00000100:00100000:3.0:1785787657.933613:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 9 00000100:00100000:3.0:1785787657.933983:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190451bdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+24:10329:x1872533744811520:12345-192.168.203.53@tcp:35:lfs.0 00000100:00100000:3.0:1785787657.934213:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190451bdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+25:10329:x1872533744811520:12345-192.168.203.53@tcp:35:lfs.0 Request processed in 590us (777us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1785787657.934220:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 9 00000100:00100000:3.0:1785787658.078211:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787658.078312:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744811776 00000100:00100000:2.0:1785787658.078320:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744811776 00000100:00100000:2.0:1785787658.078374:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 46 00000100:00100000:2.0:1785787658.078383:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ecb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+25:10339:x1872533744811776:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:2.0:1785787658.078411:0:9295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787658.078430:0:9295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e8481a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd37f expref: -99 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787658.078675:0:9295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1785787658.078870:0:9295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e8481a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd37f expref: 27 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787658.078884:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9190481f9600) 00010000:00010000:2.0:1785787658.078887:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785787658.078892:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e8481a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd37f expref: 27 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787658.078905:0:9295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677dc00, rc 0) 00000100:00100000:2.0:1785787658.078965:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ecb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+26:10339:x1872533744811776:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 583us (764us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1785787658.078971:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 46 00000100:00100000:0.0:1785787658.091268:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787658.103504:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744811904 00000100:00100000:1.0:1785787658.103528:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744811904 00000100:00100000:1.0:1785787658.103589:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 47 00000100:00100000:1.0:1785787658.103597:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+26:10339:x1872533744811904:12345-192.168.203.53@tcp:34:lfs.0 00010000:00010000:1.0:1785787658.103676:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84828 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.103692:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84828 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.103703:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84828 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.103717:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e8482f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.103725:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e8482f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.103747:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e8482f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.104036:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84836 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.104043:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84836 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.104050:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84836 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785787658.104089:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84836 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.104101:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84828 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.104108:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84828 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.104115:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84828 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.104121:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0e400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787658.104125:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84828 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.104132:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84828 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.104143:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9190481f9e00) 00010000:00010000:1.0:1785787658.104152:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785787658.104157:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84828 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.104163:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84828 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.104175:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e8482f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.104181:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e8482f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.104187:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e8482f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.104192:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0fe00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787658.104194:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e8482f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.104201:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e8482f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.104208:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91905685f900) 00010000:00010000:1.0:1785787658.104211:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785787658.104213:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e8482f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.104218:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e8482f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.104231:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84836 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.104243:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84836 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.104250:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84836 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.104254:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0fa00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787658.104258:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84836 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.104263:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84836 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.104270:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91905685f400) 00010000:00010000:1.0:1785787658.104272:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785787658.104274:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84836 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.104279:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84836 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787658.104354:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+26:10339:x1872533744811904:12345-192.168.203.53@tcp:34:lfs.0 Request processed in 756us (13093us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787658.104360:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 47 00000100:00100000:3.0:1785787658.113863:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787658.113933:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744812160 00000100:00100000:1.0:1785787658.113942:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744812160 00000100:00100000:1.0:1785787658.113993:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 10 00000100:00100000:1.0:1785787658.114001:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ecb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+26:10339:x1872533744812160:12345-192.168.203.53@tcp:35:lfs.0 00000100:00100000:1.0:1785787658.114415:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ecb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+27:10339:x1872533744812160:12345-192.168.203.53@tcp:35:lfs.0 Request processed in 414us (595us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1785787658.114428:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 10 00000100:00100000:1.0:1785787658.199445:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787658.199535:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744812416 00000100:00100000:2.0:1785787658.199543:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744812416 00000100:00100000:2.0:1785787658.199595:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 48 00000100:00100000:2.0:1785787658.199617:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+27:10342:x1872533744812416:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:2.0:1785787658.199641:0:9295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787658.199669:0:9295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e8483d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd386 expref: -99 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787658.199747:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84844 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787658.199761:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84844 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787658.199773:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84844 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787658.199785:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e8484b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787658.199792:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e8484b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787658.199798:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e8484b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787658.200423:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84852 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787658.200432:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84852 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787658.200438:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84852 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785787658.200446:0:9295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1785787658.200530:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84844 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787658.200536:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84844 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787658.200542:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84844 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787658.200546:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677cc00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787658.200550:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84844 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787658.200556:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84844 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787658.200567:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9190481f9e00) 00010000:00010000:3.0:1785787658.200569:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787658.200572:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84844 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787658.200586:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84844 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787658.200595:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e8484b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787658.200600:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e8484b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787658.200605:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e8484b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787658.200609:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677da00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787658.200611:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e8484b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787658.200616:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e8484b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787658.200621:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9190481f9100) 00010000:00010000:3.0:1785787658.200623:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787658.200626:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e8484b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787658.200631:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e8484b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787658.200677:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e8483d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd386 expref: 30 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787658.200691:0:9295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84852 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd386 expref: 29 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787658.200706:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91905685f400) 00010000:00010000:3.0:1785787658.200708:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785787658.200711:0:9295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f902600, rc 0) 00000100:00100000:3.0:1785787658.200778:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+29:10342:x1872533744812416:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 1163us (1341us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1785787658.200785:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 48 00000100:00100000:0.0:1785787658.204255:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787658.204335:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744812544 00000100:00100000:1.0:1785787658.204344:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744812544 00000100:00100000:1.0:1785787658.204404:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 49 00000100:00100000:1.0:1785787658.204414:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+29:10342:x1872533744812544:12345-192.168.203.53@tcp:54:lfs.0 00010000:00010000:1.0:1785787658.204471:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84860 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.204485:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84860 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.204496:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84860 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.204527:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84860 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.204534:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84860 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.204540:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84860 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.204545:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0fe00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787658.204548:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84860 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.204554:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84860 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.204580:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91905685f400) 00010000:00010000:1.0:1785787658.204582:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785787658.204586:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84860 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.204591:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84860 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787658.204662:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+29:10342:x1872533744812544:12345-192.168.203.53@tcp:54:lfs.0 Request processed in 248us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787658.204669:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 49 00000100:00100000:2.0:1785787658.206998:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787658.207119:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744812800 00000100:00100000:1.0:1785787658.207126:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744812800 00000100:00100000:1.0:1785787658.207175:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 11 00000100:00100000:1.0:1785787658.207184:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905c5f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+29:10342:x1872533744812800:12345-192.168.203.53@tcp:35:lfs.0 00000100:00100000:1.0:1785787658.207379:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905c5f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+30:10342:x1872533744812800:12345-192.168.203.53@tcp:35:lfs.0 Request processed in 196us (386us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1785787658.207385:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 11 00000100:00100000:2.0:1785787658.574336:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787658.574510:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744813056 00000100:00100000:1.0:1785787658.574521:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744813056 00000100:00100000:1.0:1785787658.574665:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 50 00000100:00100000:1.0:1785787658.574675:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905c5f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+30:10373:x1872533744813056:12345-192.168.203.53@tcp:101:cat.0 00010000:00010000:1.0:1785787658.574700:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787658.574720:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84867 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd38d expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.574887:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e8486e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.574910:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e8486e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.574921:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e8486e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785787658.574931:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1785787658.575252:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84867 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd38d expref: 33 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.575269:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e8486e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd38d expref: 32 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.575277:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91905685f400) 00010000:00010000:1.0:1785787658.575280:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785787658.575282:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919043c0e400, rc 0) 00000100:00100000:1.0:1785787658.575334:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905c5f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+32:10373:x1872533744813056:12345-192.168.203.53@tcp:101:cat.0 Request processed in 661us (1005us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1785787658.575339:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 50 00000100:00100000:0.0:1785787658.584725:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787658.585185:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744813312 00000100:00100000:1.0:1785787658.585194:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744813312 00000100:00100000:1.0:1785787658.585257:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 12 00000100:00100000:1.0:1785787658.585267:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+32:10373:x1872533744813312:12345-192.168.203.53@tcp:35:cat.0 00000100:00100000:1.0:1785787658.585549:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+33:10373:x1872533744813312:12345-192.168.203.53@tcp:35:cat.0 Request processed in 283us (830us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1785787658.585557:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 12 00000100:00100000:0.0:1785787658.585796:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787658.586211:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744813440 00000100:00100000:3.0:1785787658.586217:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744813440 00000100:00100000:3.0:1785787658.586256:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 3 00000100:00100000:3.0:1785787658.586262:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051466050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79280304-55c6-4698-bfc3-29d14648ba45+33:2388:x1872533744813440:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785787658.586272:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787658.586292:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e8486e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd38d expref: 33 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787658.586306:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91905685f400) 00010000:00010000:3.0:1785787658.586310:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787658.586337:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051466050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79280304-55c6-4698-bfc3-29d14648ba45+32:2388:x1872533744813440:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 75us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787658.586343:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 3 00010000:00010000:3.0:1785787658.748325:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787658.749911:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787658.750063:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744813696 00000100:00100000:1.0:1785787658.750078:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744813696 00000100:00100000:1.0:1785787658.750135:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 51 00000100:00100000:1.0:1785787658.750143:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+32:10379:x1872533744813696:12345-192.168.203.53@tcp:101:dd.0 00010000:00010000:1.0:1785787658.750162:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787658.750165:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1785787658.750187:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e847d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd363 expref: 32 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.750202:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9190481f9e00) 00010000:00010000:1.0:1785787658.750206:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785787658.750216:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e8487c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd394 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.750295:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84883 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.750306:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84852 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd386 expref: 32 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.750312:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84883 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.750338:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84852 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd386 expref: 32 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.750349:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84852 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd386 expref: 32 pid: 9295 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787658.750360:0:5821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bd7b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5821:1872533770016256:192.168.203.53@tcp:104: 00000100:00100000:1.0:1785787658.750460:0:5821:0:(client.c:2702:ptlrpc_set_wait()) set ffff91904689b000 going to sleep for 11 seconds 00000100:00100000:1.0:1785787658.760329:0:5821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bd7b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5821:1872533770016256:192.168.203.53@tcp:104: 00010000:00010000:1.0:1785787658.760362:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84883 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787658.761687:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787658.761794:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744813824 00000100:00100000:1.0:1785787658.761801:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744813824 00010000:00010000:1.0:1785787658.761858:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84852 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd386 expref: 33 pid: 9295 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787658.761890:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 38 00000100:00100000:1.0:1785787658.761898:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79280304-55c6-4698-bfc3-29d14648ba45+33:2391:x1872533744813824:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785787658.761911:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785787658.761918:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84852 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd386 expref: 33 pid: 9295 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.761930:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84852 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd386 expref: 33 pid: 9295 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.761951:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84852 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd386 expref: 33 pid: 9295 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.761976:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91905685f400) 00010000:00010000:1.0:1785787658.761981:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84883 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.761991:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84883 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.762014:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84883 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.762035:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785787658.762073:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79280304-55c6-4698-bfc3-29d14648ba45+32:2391:x1872533744813824:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 175us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787658.762080:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 38 00010000:00010000:3.0:1785787658.768477:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84883 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787658.768492:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84883 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785787658.768539:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1785787658.768712:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e8487c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd394 expref: 33 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787658.768742:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84883 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd394 expref: 32 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787658.768752:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91905685f400) 00010000:00010000:3.0:1785787658.768755:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1785787658.768758:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919043c0e400, rc 0) 00000100:00100000:3.0:1785787658.768820:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+32:10379:x1872533744813696:12345-192.168.203.53@tcp:101:dd.0 Request processed in 18676us (18913us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1785787658.769237:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 51 00000100:00100000:2.0:1785787658.773313:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787658.774751:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744814080 00000100:00100000:3.0:1785787658.774762:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744814080 00000100:00100000:3.0:1785787658.774817:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 52 00000100:00100000:3.0:1785787658.774839:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+32:10379:x1872533744814080:12345-192.168.203.53@tcp:36:dd.0 00010000:00010000:3.0:1785787658.775092:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84891 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787658.775116:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84891 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787658.775125:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84891 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785787658.775166:0:9295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1785787658.775195:0:9295:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f5f64ce6 reply state 000000005db07650 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84891 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787658.775202:0:9295:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785787658.775269:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+35:10379:x1872533744814080:12345-192.168.203.53@tcp:36:dd.0 Request processed in 444us (1962us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1785787658.775276:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 52 00000020:00080000:3.0:1785787658.775280:0:9295:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1785787658.778739:0:3320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84891 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.778755:0:3320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84891 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.778763:0:3320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84891 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.778769:0:3320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903e00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787658.778773:0:3320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84891 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.778781:0:3320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84891 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.778797:0:3320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91905685f400) 00010000:00010000:1.0:1785787658.778800:0:3320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785787658.778804:0:3320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84891 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787658.778810:0:3320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84891 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787659.184321:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787659.184957:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744814208 00000100:00100000:3.0:1785787659.184968:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744814208 00000100:00100000:3.0:1785787659.185048:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 53 00000100:00100000:3.0:1785787659.185058:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+34:10394:x1872533744814208:12345-192.168.203.53@tcp:101:stat.0 00010000:00010000:3.0:1785787659.185080:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787659.185100:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e84898 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd39b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.185159:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903400/0xe2c2ff68a6e8489f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.185173:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903400/0xe2c2ff68a6e8489f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.185184:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903400/0xe2c2ff68a6e8489f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.185197:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e848a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.185204:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e848a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.185228:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e848a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.185528:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e848ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.185539:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84883 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd394 expref: 35 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.185547:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e848ad lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1785787659.185694:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1785787659.185922:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84883 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd394 expref: 35 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.185939:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84883 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd394 expref: 35 pid: 5821 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787659.185954:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076ec8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5820:1872533770016384:192.168.203.53@tcp:104: 00000100:00100000:3.0:1785787659.186115:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905064a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785787659.197131:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787659.200668:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744814464 00000100:00100000:1.0:1785787659.200681:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744814464 00000100:00100000:1.0:1785787659.200751:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 13 00000100:00100000:1.0:1785787659.200761:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+36:5608:x1872533744814464:12345-192.168.203.53@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1785787659.201153:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+37:5608:x1872533744814464:12345-192.168.203.53@tcp:35:ldlm_bl.0 Request processed in 392us (4030us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1785787659.201161:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 13 00000100:00100000:3.0:1785787659.206562:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076ec8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5820:1872533770016384:192.168.203.53@tcp:104: 00010000:00010000:3.0:1785787659.206588:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e848ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787659.218576:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787659.218747:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744814592 00000100:00100000:3.0:1785787659.218756:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744814592 00010000:00010000:3.0:1785787659.218797:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84883 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd394 expref: 37 pid: 5821 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787659.218882:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 39 00000100:00100000:3.0:1785787659.218891:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79280304-55c6-4698-bfc3-29d14648ba45+37:2390:x1872533744814592:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785787659.218905:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787659.218913:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84883 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd394 expref: 37 pid: 5821 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.218925:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84883 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd394 expref: 37 pid: 5821 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.218945:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84883 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd394 expref: 37 pid: 5821 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.218961:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91905685f400) 00010000:00010000:3.0:1785787659.218966:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e848ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.218976:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e848ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.218985:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e848ad lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.219015:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787659.219075:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79280304-55c6-4698-bfc3-29d14648ba45+36:2390:x1872533744814592:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 184us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787659.219083:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 39 00010000:00010000:2.0:1785787659.220449:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e848ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787659.220470:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e848ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787659.220555:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1785787659.220559:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785787659.220595:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e848ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787659.220607:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e848ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787659.220616:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903400/0xe2c2ff68a6e8489f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787659.220623:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903400/0xe2c2ff68a6e8489f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787659.220631:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903400/0xe2c2ff68a6e8489f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787659.220647:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787659.220651:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903400/0xe2c2ff68a6e8489f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787659.220659:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903400/0xe2c2ff68a6e8489f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787659.220670:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9190481f9e00) 00010000:00010000:2.0:1785787659.220673:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787659.220677:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903400/0xe2c2ff68a6e8489f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787659.220692:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903400/0xe2c2ff68a6e8489f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787659.220704:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e848a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787659.220710:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e848a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787659.220717:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e848a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787659.220722:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787659.220725:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e848a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787659.220731:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e848a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787659.220739:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff919055acd100) 00010000:00010000:2.0:1785787659.220741:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787659.220743:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e848a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787659.220749:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e848a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787659.220786:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e84898 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd39b expref: 36 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787659.220799:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e848ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd39b expref: 35 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787659.220812:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91905685f400) 00010000:00010000:2.0:1785787659.220814:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785787659.220817:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f903e00, rc 0) 00000100:00100000:2.0:1785787659.221481:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+35:10394:x1872533744814208:12345-192.168.203.53@tcp:101:stat.0 Request processed in 36423us (37166us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787659.221489:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 53 00000100:00100000:2.0:1785787659.320939:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787659.321032:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744814848 00000100:00100000:1.0:1785787659.321041:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744814848 00000100:00100000:1.0:1785787659.321098:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 54 00000100:00100000:1.0:1785787659.321109:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+35:10400:x1872533744814848:12345-192.168.203.53@tcp:36:truncate.0 00010000:00010000:1.0:1785787659.321161:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785787659.321188:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e848ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd39b expref: 35 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787659.321206:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91905685f400) 00010000:00010000:1.0:1785787659.321211:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785787659.321398:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e848b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787659.321411:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e848b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787659.321421:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e848b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785787659.321487:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1785787659.321523:0:5822:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000026b7d2fe reply state 000000007f119841 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e848b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787659.321532:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785787659.321623:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+37:10400:x1872533744814848:12345-192.168.203.53@tcp:36:truncate.0 Request processed in 515us (693us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1785787659.321630:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 54 00000020:00080000:1.0:1785787659.321634:0:5822:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1785787659.324718:0:3319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e848b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.324745:0:3319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e848b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.324752:0:3319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e848b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.324758:0:3319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0fa00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787659.324763:0:3319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e848b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.324770:0:3319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e848b4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.324785:0:3319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91905685f400) 00010000:00010000:3.0:1785787659.324788:0:3319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787659.324792:0:3319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e848b4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.324797:0:3319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e848b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787659.613455:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787659.613591:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744814976 00000100:00100000:3.0:1785787659.613601:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744814976 00000100:00100000:3.0:1785787659.613664:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 55 00000100:00100000:3.0:1785787659.613673:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+36:10414:x1872533744814976:12345-192.168.203.53@tcp:101:stat.0 00010000:00010000:3.0:1785787659.613695:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787659.613715:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e848bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd3a2 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.613778:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e848c2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.613804:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e848c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.613815:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e848c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.613862:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e848c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.613869:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e848c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.613876:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e848c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.614161:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e848d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.614170:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e848d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.614177:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e848d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785787659.614209:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1785787659.614212:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1785787659.614233:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e848d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.614244:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e848d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.614261:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e848c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.614267:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e848c2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.614272:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e848c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.614277:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787659.614281:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e848c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.614287:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e848c2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.614298:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9190481f9e00) 00010000:00010000:3.0:1785787659.614301:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787659.614304:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e848c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.614309:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e848c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.614320:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e848c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.614326:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e848c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.614332:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e848c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.614342:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787659.614345:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e848c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.614350:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e848c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.614358:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff919055acd500) 00010000:00010000:3.0:1785787659.614359:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787659.614362:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e848c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.614367:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e848c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.614394:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e848bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3a2 expref: 38 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.614407:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e848d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3a2 expref: 37 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.614415:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91905685f400) 00010000:00010000:3.0:1785787659.614417:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785787659.614420:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f902800, rc 0) 00000100:00100000:3.0:1785787659.614478:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+37:10414:x1872533744814976:12345-192.168.203.53@tcp:101:stat.0 Request processed in 805us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787659.614485:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 55 00000100:00100000:0.0:1785787659.761258:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787659.761347:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744815232 00000100:00100000:1.0:1785787659.761362:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744815232 00000100:00100000:1.0:1785787659.761448:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 56 00000100:00100000:1.0:1785787659.761459:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+37:10424:x1872533744815232:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:1.0:1785787659.761486:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787659.761522:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e848d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd3a9 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785787659.761912:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1785787659.762101:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e848d7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3a9 expref: 39 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787659.762118:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9190481f9600) 00010000:00010000:1.0:1785787659.762121:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785787659.762126:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e848d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3a9 expref: 39 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787659.762141:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919043c0ec00, rc 0) 00000100:00100000:1.0:1785787659.762356:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+38:10424:x1872533744815232:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 897us (1104us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1785787659.762364:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 56 00010000:00010000:3.0:1785787659.763563:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787659.765338:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787659.765407:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744815488 00000100:00100000:1.0:1785787659.765416:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744815488 00000100:00100000:1.0:1785787659.765478:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 14 00000100:00100000:1.0:1785787659.765488:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+38:10424:x1872533744815488:12345-192.168.203.53@tcp:35:lfs.0 00000100:00100000:1.0:1785787659.766318:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+39:10424:x1872533744815488:12345-192.168.203.53@tcp:35:lfs.0 Request processed in 829us (986us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1785787659.766328:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 14 00000100:00100000:3.0:1785787659.884969:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787659.886713:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744815744 00000100:00100000:2.0:1785787659.886730:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744815744 00000100:00100000:2.0:1785787659.886818:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 57 00000100:00100000:2.0:1785787659.886892:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ec8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+39:10430:x1872533744815744:12345-192.168.203.53@tcp:101:bash.0 00010000:00010000:2.0:1785787659.886926:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787659.886958:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e848e5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd3b0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787659.887720:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e848ec lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787659.887737:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e848d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3a2 expref: 40 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787659.887748:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e848ec lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787659.887792:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e848d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3a2 expref: 40 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787659.887854:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e848d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3a2 expref: 40 pid: 5821 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787659.887869:0:5821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd92d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5821:1872533770016512:192.168.203.53@tcp:104: 00000100:00100000:2.0:1785787659.887984:0:5821:0:(client.c:2702:ptlrpc_set_wait()) set ffff919076ddfa80 going to sleep for 11 seconds 00000100:00100000:0.0:1785787659.889904:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787659.889991:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744815872 00000100:00100000:1.0:1785787659.890001:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744815872 00010000:00010000:1.0:1785787659.890035:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e848d0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3a2 expref: 41 pid: 5821 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787659.890076:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 40 00000100:00100000:1.0:1785787659.890085:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79280304-55c6-4698-bfc3-29d14648ba45+41:2391:x1872533744815872:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785787659.890097:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785787659.890104:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e848d0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3a2 expref: 41 pid: 5821 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787659.890118:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e848d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3a2 expref: 41 pid: 5821 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787659.890139:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91905685f400) 00010000:00010000:1.0:1785787659.890144:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e848ec lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787659.890163:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e848ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787659.890171:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e848ec lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787659.890187:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785787659.890228:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79280304-55c6-4698-bfc3-29d14648ba45+41:2391:x1872533744815872:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 143us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787659.890235:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 40 00010000:00010000:2.0:1785787659.891816:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e848d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3a2 expref: 40 pid: 5821 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787659.891873:0:5821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd92d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5821:1872533770016512:192.168.203.53@tcp:104: 00010000:00010000:2.0:1785787659.891900:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e848ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787659.891911:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e848ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787659.891918:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e848ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787659.891940:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1785787659.892121:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e848e5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3b0 expref: 41 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787659.892140:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e848ec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3b0 expref: 40 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787659.892150:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91905685f400) 00010000:00010000:2.0:1785787659.892163:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1785787659.892167:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677ca00, rc 0) 00000100:00100000:2.0:1785787659.892269:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ec8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+40:10430:x1872533744815744:12345-192.168.203.53@tcp:101:bash.0 Request processed in 5442us (7312us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1785787659.892278:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 57 00000100:00100000:1.0:1785787659.911916:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787659.911962:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787659.911991:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787659.912018:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787659.912090:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744816256 00000100:00100000:2.0:1785787659.912102:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744816256 00000100:00100000:2.0:1785787659.912164:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 299 00000100:00100000:2.0:1785787659.912173:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051507450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2390:x1872533744816256:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:2.0:1785787659.912251:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051507450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2390:x1872533744816256:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 79us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787659.912259:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 299 00000100:00100000:3.0:1785787659.912362:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744816128 00000100:00100000:3.0:1785787659.912367:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744816128 00000100:00100000:3.0:1785787659.912415:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744816512 00000100:00100000:3.0:1785787659.912418:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744816512 00000100:00100000:3.0:1785787659.912455:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 159 00000100:00100000:3.0:1785787659.912463:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4ec65b7-e63e-42dc-becf-cba362002085+5:2390:x1872533744816512:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1785787659.912511:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4ec65b7-e63e-42dc-becf-cba362002085+5:2390:x1872533744816512:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 37us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787659.912518:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 159 00000100:00100000:3.0:1785787659.912533:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 58 00000100:00100000:3.0:1785787659.912540:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+40:10430:x1872533744816128:12345-192.168.203.53@tcp:36:bash.0 00010000:00010000:3.0:1785787659.912890:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e848fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.912912:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e848fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.912925:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e848fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785787659.912983:0:9295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:3.0:1785787659.913008:0:9295:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008c43a863 reply state 0000000054bb0d41 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e848fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787659.913019:0:9295:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785787659.913081:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+43:10430:x1872533744816128:12345-192.168.203.53@tcp:36:bash.0 Request processed in 541us (1176us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1785787659.913088:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 58 00000020:00080000:3.0:1785787659.913109:0:9295:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:3.0:1785787659.913127:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1785787659.914476:0:3320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e848fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787659.914490:0:3320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e848fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787659.914506:0:3320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e848fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787659.914512:0:3320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f902600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787659.914518:0:3320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e848fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787659.914526:0:3320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e848fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787659.914542:0:3320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91905685f400) 00010000:00010000:2.0:1785787659.914545:0:3320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787659.914563:0:3320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e848fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787659.914570:0:3320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e848fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787659.914980:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744816384 00000100:00100000:0.0:1785787659.914987:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744816384 00000100:00100000:0.0:1785787659.915045:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 86 00000100:00100000:0.0:1785787659.915056:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:79280304-55c6-4698-bfc3-29d14648ba45+7:2390:x1872533744816384:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1785787659.915118:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:79280304-55c6-4698-bfc3-29d14648ba45+7:2390:x1872533744816384:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 64us (3154us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787659.915126:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 86 00000100:00080000:3.0:1785787659.915218:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785787659.923921:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787659.924066:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744816640 00000100:00100000:3.0:1785787659.924077:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744816640 00000100:00100000:3.0:1785787659.924142:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 59 00000100:00100000:3.0:1785787659.924151:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+42:10430:x1872533744816640:12345-192.168.203.53@tcp:101:bash.0 00010000:00010000:3.0:1785787659.924179:0:9295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787659.924205:0:9295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e84901 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd3b7 expref: -99 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.924310:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84908 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.924325:0:9295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e848ec lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3b0 expref: 43 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.924333:0:9295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84908 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.924369:0:9295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e848ec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3b0 expref: 43 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.924381:0:9295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e848ec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3b0 expref: 43 pid: 5821 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787659.924395:0:9295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076ec9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9295:1872533770016640:192.168.203.53@tcp:104: 00000100:00100000:3.0:1785787659.924486:0:9295:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905064a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785787659.927270:0:9295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076ec9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9295:1872533770016640:192.168.203.53@tcp:104: 00010000:00010000:3.0:1785787659.927324:0:9295:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84908 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787659.927794:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787659.928012:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744816768 00000100:00100000:3.0:1785787659.928019:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744816768 00010000:00010000:3.0:1785787659.928053:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e848ec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3b0 expref: 44 pid: 5821 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787659.928088:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 41 00000100:00100000:3.0:1785787659.928096:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79280304-55c6-4698-bfc3-29d14648ba45+44:2391:x1872533744816768:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785787659.928109:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787659.928116:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e848ec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3b0 expref: 44 pid: 5821 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.928126:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e848ec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3b0 expref: 44 pid: 5821 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.928147:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e848ec lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3b0 expref: 44 pid: 5821 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.928162:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91905685f400) 00010000:00010000:3.0:1785787659.928167:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84908 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.928178:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84908 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.928188:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84908 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787659.928227:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785787659.928336:0:9295:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84908 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787659.928344:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84908 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785787659.928392:0:9295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1785787659.928396:0:9295:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1785787659.928421:0:9295:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84908 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787659.928458:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e84901 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3b7 expref: 44 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787659.928473:0:9295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84908 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3b7 expref: 43 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787659.928487:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91905685f400) 00010000:00010000:1.0:1785787659.928490:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785787659.928493:0:9295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f903800, rc 0) 00000100:00100000:3.0:1785787659.928561:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79280304-55c6-4698-bfc3-29d14648ba45+43:2391:x1872533744816768:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 464us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787659.928569:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 41 00000100:00100000:1.0:1785787659.929365:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+42:10430:x1872533744816640:12345-192.168.203.53@tcp:101:bash.0 Request processed in 5213us (5454us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787659.929372:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 59 00000100:00100000:2.0:1785787659.936284:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787659.936369:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744817024 00000100:00100000:3.0:1785787659.936382:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744817024 00000100:00100000:3.0:1785787659.936458:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 15 00000100:00100000:3.0:1785787659.936470:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190451bd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+42:10430:x1872533744817024:12345-192.168.203.53@tcp:35:bash.0 00000100:00100000:3.0:1785787659.936775:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190451bd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+43:10430:x1872533744817024:12345-192.168.203.53@tcp:35:bash.0 Request processed in 307us (505us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1785787659.936784:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 15 00000100:00100000:2.0:1785787660.066220:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787660.066332:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744817280 00000100:00100000:3.0:1785787660.066345:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744817280 00000100:00100000:3.0:1785787660.066417:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 60 00000100:00100000:3.0:1785787660.066429:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+43:10439:x1872533744817280:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:3.0:1785787660.066458:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787660.066485:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e8490f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd3be expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785787660.066887:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1785787660.067079:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e8490f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3be expref: 45 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.067096:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9190481f9600) 00010000:00010000:3.0:1785787660.067100:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785787660.067114:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e8490f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3be expref: 45 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.067129:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f903200, rc 0) 00000100:00100000:3.0:1785787660.067208:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+44:10439:x1872533744817280:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 781us (1001us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1785787660.067215:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 60 00000100:00100000:0.0:1785787660.070903:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787660.070987:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744817408 00000100:00100000:1.0:1785787660.070996:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744817408 00000100:00100000:1.0:1785787660.071056:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 61 00000100:00100000:1.0:1785787660.071066:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+44:10439:x1872533744817408:12345-192.168.203.53@tcp:34:lfs.0 00010000:00010000:1.0:1785787660.071147:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e8491d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787660.071166:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e8491d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787660.071180:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e8491d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787660.071197:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84924 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787660.071205:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84924 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787660.071213:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84924 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787660.071546:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e8492b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787660.071563:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e8492b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787660.071571:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e8492b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785787660.071629:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e8492b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787660.071652:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e8491d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787660.071658:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e8491d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787660.071665:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e8491d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787660.071670:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0ec00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787660.071674:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e8491d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787660.071680:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e8491d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787660.071690:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9190481f9e00) 00010000:00010000:1.0:1785787660.071693:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785787660.071697:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e8491d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787660.071702:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e8491d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787660.071719:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84924 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787660.071724:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84924 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787660.071729:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84924 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787660.071733:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0fa00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787660.071735:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84924 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787660.071739:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84924 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787660.071745:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91905685f900) 00010000:00010000:1.0:1785787660.071747:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785787660.071748:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84924 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787660.071753:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84924 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787660.071766:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e8492b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787660.071770:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e8492b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787660.071774:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e8492b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787660.071782:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0e400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787660.071785:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e8492b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787660.071790:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e8492b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787660.071795:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91905685f400) 00010000:00010000:1.0:1785787660.071797:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785787660.071799:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e8492b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787660.071803:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e8492b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787660.071907:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+44:10439:x1872533744817408:12345-192.168.203.53@tcp:34:lfs.0 Request processed in 842us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787660.071914:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 61 00000100:00100000:1.0:1785787660.074002:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787660.074087:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744817664 00000100:00100000:3.0:1785787660.074095:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744817664 00000100:00100000:3.0:1785787660.074150:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 16 00000100:00100000:3.0:1785787660.074159:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+44:10439:x1872533744817664:12345-192.168.203.53@tcp:35:lfs.0 00000100:00100000:3.0:1785787660.074758:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+45:10439:x1872533744817664:12345-192.168.203.53@tcp:35:lfs.0 Request processed in 423us (583us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1785787660.074767:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 16 00000100:00100000:2.0:1785787660.181117:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787660.182936:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744817920 00000100:00100000:3.0:1785787660.182949:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744817920 00000100:00100000:3.0:1785787660.183021:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 62 00000100:00100000:3.0:1785787660.183034:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+45:10443:x1872533744817920:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:3.0:1785787660.183068:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787660.183094:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e84932 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd3c5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.183189:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e84939 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.183206:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e84939 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.183241:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e84939 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.183260:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84940 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.183268:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84940 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.183275:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84940 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.183765:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e84947 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.183775:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e84947 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.183782:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e84947 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785787660.183793:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1785787660.185008:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e84939 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.185018:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e84939 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.185024:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e84939 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.185029:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787660.185041:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e84939 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.185049:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e84939 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.185061:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9190481f9e00) 00010000:00010000:3.0:1785787660.185064:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787660.185068:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e84939 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.185074:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e84939 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.185086:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84940 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.185090:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84940 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.185095:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84940 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.185100:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f902600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787660.185103:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84940 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.185108:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84940 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.185113:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff919055acd500) 00010000:00010000:3.0:1785787660.185115:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787660.185121:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84940 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.185127:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84940 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.185174:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e84932 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3c5 expref: 48 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.185185:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e84947 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3c5 expref: 47 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.185192:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91905685f400) 00010000:00010000:3.0:1785787660.185194:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785787660.185197:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f902800, rc 0) 00000100:00100000:3.0:1785787660.185275:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+47:10443:x1872533744817920:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 2245us (4173us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1785787660.185282:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 62 00000100:00100000:0.0:1785787660.200971:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787660.201081:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744818048 00000100:00100000:1.0:1785787660.201094:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744818048 00000100:00100000:1.0:1785787660.201172:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 63 00000100:00100000:1.0:1785787660.201185:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+47:10443:x1872533744818048:12345-192.168.203.53@tcp:54:lfs.0 00010000:00010000:1.0:1785787660.201276:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84955 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787660.201297:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84955 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787660.201333:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84955 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787660.201368:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84955 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787660.201377:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84955 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787660.201385:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84955 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787660.201392:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0fa00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787660.201398:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84955 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787660.201407:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84955 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787660.201421:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91905685f400) 00010000:00010000:1.0:1785787660.201424:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785787660.201429:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84955 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787660.201436:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84955 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787660.201531:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+47:10443:x1872533744818048:12345-192.168.203.53@tcp:54:lfs.0 Request processed in 348us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787660.201539:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 63 00000040:00080000:0.0:1785787660.211854:0:11564:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1785787660.212209:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905c5f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770017152:0@lo:400:kworker.0 00000100:00100000:3.0:1785787660.212289:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787660.212355:0:3334:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785787660.212380:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076ecaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3334:1872533770017024:0@lo:400:kworker.0 00000100:00100000:3.0:1785787660.212404:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787660.212488:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076ec9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3336:1872533770016896:0@lo:400:kworker.0 00000100:00100000:1.0:1785787660.212536:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787660.212560:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770017408:0@lo:400:kworker.0 00000100:00100000:1.0:1785787660.212591:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787660.212614:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1785787660.212620:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076ecb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8642023-9103-4dbf-85d1-f204189bc871:3336:1872533770016768:0@lo:400:kworker.0 00000100:00100000:1.0:1785787660.212656:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787660.212678:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3336:1872533770017280:0@lo:400:kworker.0 00000100:00100000:1.0:1785787660.212698:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787660.212724:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770016768 00000100:00100000:1.0:1785787660.212731:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770016768 00000100:00100000:1.0:1785787660.212771:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1785787660.212778:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051504850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+19:3336:x1872533770016768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787660.212825:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051504850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+19:3336:x1872533770016768:12345-0@lo:400:kworker.0 Request processed in 47us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787660.212872:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1785787660.212918:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076ecb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8642023-9103-4dbf-85d1-f204189bc871:3336:1872533770016768:0@lo:400:kworker.0 00000100:00100000:1.0:1785787660.212953:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770017024 00000100:00100000:1.0:1785787660.212956:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770017024 00000100:00080000:1.0:1785787660.212976:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785787660.212997:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770016896 00000100:00100000:1.0:1785787660.212999:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770016896 00000100:00100000:1.0:1785787660.213008:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770017280 00000100:00100000:1.0:1785787660.213010:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770017280 00000100:00080000:1.0:1785787660.213019:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785787660.213028:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1785787660.213033:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905267d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3334:x1872533770017024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787660.213065:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905267d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3334:x1872533770017024:12345-0@lo:400:kworker.0 Request processed in 32us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787660.213076:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1785787660.213087:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1785787660.213092:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3336:x1872533770016896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787660.213118:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3336:x1872533770016896:12345-0@lo:400:kworker.0 Request processed in 27us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787660.213123:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1785787660.213146:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076ecaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3334:1872533770017024:0@lo:400:kworker.0 00000100:00100000:1.0:1785787660.213161:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076ec9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3336:1872533770016896:0@lo:400:kworker.0 00000100:00100000:1.0:1785787660.213181:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1785787660.213186:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3336:x1872533770017280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787660.213214:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3336:x1872533770017280:12345-0@lo:400:kworker.0 Request processed in 28us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787660.213219:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1785787660.213235:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3336:1872533770017280:0@lo:400:kworker.0 00000100:00100000:2.0:1785787660.213383:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770017152 00000100:00100000:2.0:1785787660.213387:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770017152 00000100:00100000:2.0:1785787660.213425:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770017408 00000100:00100000:2.0:1785787660.213428:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770017408 00000100:00100000:2.0:1785787660.213446:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1785787660.213452:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905267e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3334:x1872533770017152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787660.213487:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905267e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3334:x1872533770017152:12345-0@lo:400:kworker.0 Request processed in 35us (1198us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787660.213492:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1785787660.213503:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1785787660.213508:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770017408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787660.213532:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770017408:12345-0@lo:400:kworker.0 Request processed in 24us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787660.213537:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1785787660.213570:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905c5f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770017152:0@lo:400:kworker.0 00000100:00100000:2.0:1785787660.213602:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770017408:0@lo:400:kworker.0 00000100:00080000:1.0:1785787660.214193:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785787660.214196:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785787660.218184:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787660.218306:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787660.218393:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744818432 00000100:00100000:3.0:1785787660.218405:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744818432 00000100:00100000:3.0:1785787660.218474:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 17 00000100:00100000:3.0:1785787660.218486:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+47:10443:x1872533744818432:12345-192.168.203.53@tcp:35:lfs.0 00000100:00100000:3.0:1785787660.218965:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+48:10443:x1872533744818432:12345-192.168.203.53@tcp:35:lfs.0 Request processed in 344us (522us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1785787660.218984:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 17 00000100:00100000:2.0:1785787660.219219:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744818176 00000100:00100000:2.0:1785787660.219224:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744818176 00000100:00100000:2.0:1785787660.219274:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 4 00000100:00100000:2.0:1785787660.219289:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79280304-55c6-4698-bfc3-29d14648ba45+48:2390:x1872533744818176:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785787660.219302:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785787660.219329:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e84947 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3c5 expref: 48 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787660.219350:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91905685f400) 00010000:00010000:2.0:1785787660.219355:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785787660.219393:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79280304-55c6-4698-bfc3-29d14648ba45+47:2390:x1872533744818176:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 105us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787660.219400:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 4 00000100:00100000:1.0:1785787660.486589:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787660.486713:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744818688 00000100:00100000:2.0:1785787660.486726:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744818688 00000100:00100000:2.0:1785787660.486796:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 64 00000100:00100000:2.0:1785787660.486806:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+47:10461:x1872533744818688:12345-192.168.203.53@tcp:101:cat.0 00010000:00010000:2.0:1785787660.486880:0:9295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787660.486907:0:9295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e8495c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd3cc expref: -99 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787660.487020:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e84963 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787660.487034:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e84963 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787660.487046:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e84963 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787660.487057:0:9295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1785787660.487233:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e8495c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3cc expref: 50 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787660.487253:0:9295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e84963 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3cc expref: 49 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787660.487261:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91905685f400) 00010000:00010000:2.0:1785787660.487264:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1785787660.487268:0:9295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677ce00, rc 0) 00000100:00100000:2.0:1785787660.487383:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+49:10461:x1872533744818688:12345-192.168.203.53@tcp:101:cat.0 Request processed in 578us (809us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1785787660.487390:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 64 00000100:00100000:3.0:1785787660.530611:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787660.530718:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744818816 00000100:00100000:2.0:1785787660.530733:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744818816 00000100:00100000:2.0:1785787660.530808:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 65 00000100:00100000:2.0:1785787660.530818:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+49:10462:x1872533744818816:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:2.0:1785787660.530892:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787660.530920:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84971 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd3d3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787660.530999:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84978 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787660.531014:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84978 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787660.531026:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84978 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787660.531271:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1785787660.531276:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1785787660.531351:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84978 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787660.531379:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84971 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3d3 expref: 51 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787660.531395:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84978 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3d3 expref: 50 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787660.531404:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9190481f9e00) 00010000:00010000:2.0:1785787660.531407:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785787660.531410:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677d200, rc 0) 00000100:00100000:2.0:1785787660.533750:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+50:10462:x1872533744818816:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 2920us (3142us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787660.533764:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 65 00000100:00100000:0.0:1785787660.547357:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787660.547474:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744819200 00000100:00100000:1.0:1785787660.547485:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744819200 00000100:00100000:1.0:1785787660.547564:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 18 00000100:00100000:1.0:1785787660.547577:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+50:10462:x1872533744819200:12345-192.168.203.53@tcp:35:lfs.0 00000100:00100000:1.0:1785787660.548045:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+51:10462:x1872533744819200:12345-192.168.203.53@tcp:35:lfs.0 Request processed in 469us (699us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1785787660.548069:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 18 00000100:00100000:1.0:1785787660.551204:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787660.553682:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744819328 00000100:00100000:3.0:1785787660.553693:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744819328 00000100:00100000:3.0:1785787660.553838:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 5 00000100:00100000:3.0:1785787660.553849:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79280304-55c6-4698-bfc3-29d14648ba45+51:10462:x1872533744819328:12345-192.168.203.53@tcp:103:lfs.0 00010000:00010000:3.0:1785787660.553863:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1785787660.553886:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84908 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3b7 expref: 51 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.553905:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e84963 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3cc expref: 50 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.553916:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e84813 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd378 expref: 49 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.553925:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91905685f400) 00010000:00010000:3.0:1785787660.553935:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787660.554008:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79280304-55c6-4698-bfc3-29d14648ba45+48:10462:x1872533744819328:12345-192.168.203.53@tcp:103:lfs.0 Request processed in 162us (2812us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787660.554014:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 5 00000100:00100000:2.0:1785787660.559638:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787660.560192:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744819456 00000100:00100000:1.0:1785787660.560202:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744819456 00000100:00100000:1.0:1785787660.560254:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 66 00000100:00100000:1.0:1785787660.560261:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+48:10462:x1872533744819456:12345-192.168.203.53@tcp:58:lfs.0 00010000:00010000:1.0:1785787660.560369:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e8497f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787660.560383:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e8497f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787660.560393:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e8497f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1785787660.560870:0:9295:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1785787660.561057:0:9295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1785787660.561777:0:9295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1785787660.561897:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+48:10462:x1872533744819456:12345-192.168.203.53@tcp:58:lfs.0 Request processed in 1634us (2272us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787660.561906:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 66 00000100:00100000:1.0:1785787660.591590:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787660.591789:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744819584 00000100:00100000:3.0:1785787660.591799:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744819584 00000100:00100000:3.0:1785787660.591885:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 67 00000100:00100000:3.0:1785787660.591895:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+48:10464:x1872533744819584:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:3.0:1785787660.591915:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787660.591945:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84986 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd3da expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.592008:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e8498d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.592020:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e8498d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.592030:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e8498d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.592041:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84994 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.592047:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84994 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.592052:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84994 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.592296:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e8499b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.592305:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e8499b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.592312:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e8499b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785787660.592343:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1785787660.592347:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1785787660.592364:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e8499b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.592380:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e8499b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.592389:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e8498d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.592395:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e8498d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.592402:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e8498d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.592418:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903200 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787660.592423:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e8498d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.592430:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e8498d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.592442:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9190481f9e00) 00010000:00010000:3.0:1785787660.592445:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787660.592448:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e8498d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.592455:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e8498d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.592465:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84994 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.592471:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84994 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.592482:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84994 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.592487:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f902600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787660.592490:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84994 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.592522:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84994 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.592530:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff919055acd500) 00010000:00010000:3.0:1785787660.592532:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787660.592535:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84994 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.592542:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84994 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.592569:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84986 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3da expref: 50 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.592581:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e8499b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3da expref: 49 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787660.592588:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91905685f900) 00010000:00010000:3.0:1785787660.592590:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785787660.593342:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f903600, rc 0) 00000100:00100000:3.0:1785787660.593435:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+49:10464:x1872533744819584:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 1541us (1854us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787660.593450:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 67 00000100:00100000:2.0:1785787660.723448:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bd98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770017536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785787660.723519:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787660.723680:0:6621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770017536 00000100:00100000:0.0:1785787660.723741:0:6621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770017536 00000100:00100000:0.0:1785787660.723862:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1785787660.723872:0:6621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770017536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785787660.723905:0:6621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785787660.723952:0:6621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770017536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787660.724000:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1785787660.724488:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bd98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770017536:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785787660.787089:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1785787661.235984:0:11564:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1785787661.235991:0:11564:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1785787661.236033:0:11564:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1785787661.236038:0:11564:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1785787661.236147:0:11564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076ecaa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11564:1872533770017664:192.168.203.53@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1785787661.236259:0:11564:0:(client.c:2702:ptlrpc_set_wait()) set ffff91904830bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1785787661.241846:0:11564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076ecaa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11564:1872533770017664:192.168.203.53@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1785787661.259180:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787661.259221:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744819712 00000100:00100000:1.0:1785787661.259230:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744819712 00000100:00100000:1.0:1785787661.259282:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 1 00000100:00100000:1.0:1785787661.259292:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ecb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:79280304-55c6-4698-bfc3-29d14648ba45+49:10475:x1872533744819712:12345-192.168.203.53@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1785787661.259363:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ecb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:79280304-55c6-4698-bfc3-29d14648ba45+49:10475:x1872533744819712:12345-192.168.203.53@tcp:900:lhsmtool_posix.0 Request processed in 72us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787661.259370:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 1 00000100:00080000:1.0:1785787661.259387:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785787661.264889:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787661.267824:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744819840 00000100:00100000:0.0:1785787661.267849:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744819840 00000100:00100000:0.0:1785787661.267914:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 68 00000100:00100000:0.0:1785787661.267924:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+49:10475:x1872533744819840:12345-192.168.203.53@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1785787661.267949:0:5822:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1785787661.268046:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+49:10475:x1872533744819840:12345-192.168.203.53@tcp:53:lhsmtool_posix.0 Request processed in 124us (3163us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787661.268053:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 68 00000100:00100000:1.0:1785787661.276573:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787661.276675:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744819968 00000100:00100000:2.0:1785787661.276691:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744819968 00000100:00100000:2.0:1785787661.276735:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 69 00000100:00100000:2.0:1785787661.276752:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+49:10475:x1872533744819968:12345-192.168.203.53@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1785787661.276824:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d600/0xe2c2ff68a6e849a2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.276854:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d600/0xe2c2ff68a6e849a2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.276865:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d600/0xe2c2ff68a6e849a2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.276878:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e849a9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.276883:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e849a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.276889:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e849a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.276909:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e849b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.276915:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e849b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.276920:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e849b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787661.276951:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1785787661.276954:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785787661.276964:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e849b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.276983:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d600/0xe2c2ff68a6e849a2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.276988:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d600/0xe2c2ff68a6e849a2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.276994:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d600/0xe2c2ff68a6e849a2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.276999:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677d600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787661.277002:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d600/0xe2c2ff68a6e849a2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.277008:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d600/0xe2c2ff68a6e849a2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.277017:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9190481f9400) 00010000:00010000:2.0:1785787661.277019:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787661.277022:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d600/0xe2c2ff68a6e849a2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.277027:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d600/0xe2c2ff68a6e849a2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.277036:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e849a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.277040:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e849a9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.277045:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e849a9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.277053:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677dc00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787661.277056:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e849a9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.277060:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e849a9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.277066:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9190481f9800) 00010000:00010000:2.0:1785787661.277068:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787661.277070:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e849a9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.277074:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e849a9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.277086:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e849b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.277090:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e849b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.277094:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e849b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.277098:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677da00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787661.277100:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e849b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.277104:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e849b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.277117:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91905685f900) 00010000:00010000:2.0:1785787661.277118:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787661.277121:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e849b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.277125:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e849b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787661.277182:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+49:10475:x1872533744819968:12345-192.168.203.53@tcp:34:lhsmtool_posix.0 Request processed in 431us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787661.277189:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 69 00000100:00100000:0.0:1785787661.294488:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787661.296531:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744820224 00000100:00100000:2.0:1785787661.296542:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744820224 00000100:00100000:2.0:1785787661.296597:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 70 00000100:00100000:2.0:1785787661.296606:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+49:10475:x1872533744820224:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1785787661.296631:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787661.296722:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e849b7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd3e1 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.296815:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e849be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.296842:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e849be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.296854:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e849be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787661.296865:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1785787661.296961:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e849be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.296969:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e849be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.296975:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e849be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.296981:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677dc00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787661.296985:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e849be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.296993:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e849be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.297004:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91905685f900) 00010000:00010000:2.0:1785787661.297007:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785787661.297012:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e849be lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.297018:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e849be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.297050:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e849b7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3e1 expref: 51 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.297059:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9190481f9400) 00010000:00010000:2.0:1785787661.297062:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785787661.297065:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e849b7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3e1 expref: 51 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.297083:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677da00, rc 0) 00000100:00100000:2.0:1785787661.298482:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+50:10475:x1872533744820224:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 1873us (3997us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1785787661.298490:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 70 00000100:00100000:2.0:1785787661.305927:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787661.306000:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744820352 00000100:00100000:3.0:1785787661.306010:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744820352 00000100:00100000:3.0:1785787661.306060:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 71 00000100:00100000:3.0:1785787661.306068:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+50:10475:x1872533744820352:12345-192.168.203.53@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1785787661.306097:0:5821:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1785787661.306198:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+50:10475:x1872533744820352:12345-192.168.203.53@tcp:53:lhsmtool_posix.0 Request processed in 130us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787661.306204:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 71 00000100:00100000:0.0:1785787661.308613:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787661.308780:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744820608 00000100:00100000:1.0:1785787661.308787:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744820608 00000100:00100000:1.0:1785787661.308861:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 72 00000100:00100000:1.0:1785787661.308870:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+50:10475:x1872533744820608:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1785787661.308887:0:9295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787661.308890:0:9295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1785787661.308915:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84978 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3d3 expref: 50 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787661.308934:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9190481f9e00) 00010000:00010000:1.0:1785787661.308938:0:9295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785787661.308951:0:9295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e849cc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd3e8 expref: -99 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785787661.309574:0:9295:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1785787661.309908:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e849d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787661.309931:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e849d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787661.309940:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e849d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787661.309987:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e849cc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3e8 expref: 52 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787661.309999:0:9295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e849d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3e8 expref: 51 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787661.310005:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91905685fb00) 00010000:00010000:1.0:1785787661.310007:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785787661.310010:0:9295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919043c0fa00, rc 0) 00000100:00100000:1.0:1785787661.310082:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+51:10475:x1872533744820608:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 1213us (1474us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1785787661.310088:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 72 00000100:00100000:0.0:1785787661.337544:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787661.337713:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744820864 00000100:00100000:3.0:1785787661.337723:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744820864 00000100:00100000:3.0:1785787661.337774:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 73 00000100:00100000:3.0:1785787661.337783:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+51:10475:x1872533744820864:12345-192.168.203.53@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1785787661.337858:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787661.337882:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e849d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3e8 expref: 51 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.337897:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91905685fb00) 00010000:00010000:3.0:1785787661.337906:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785787661.337925:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e849e1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.337937:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e849e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.337944:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e849e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.338013:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e849e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xdc92002f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.338020:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e849e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xdc92002f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.338026:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e849e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xdc92002f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.338236:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e849e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.338244:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e849e1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.338250:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e849e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.338255:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787661.338258:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e849e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.338264:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e849e1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.338271:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9190481f9e00) 00010000:00010000:3.0:1785787661.338273:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787661.338276:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e849e1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.338280:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e849e1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.338294:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e849e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xdc92002f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.338299:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e849e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xdc92002f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.338304:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e849e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xdc92002f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.338308:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f902600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787661.338310:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e849e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xdc92002f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.338315:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e849e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xdc92002f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.338320:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xdc92002f (ffff919055acd500) 00010000:00010000:3.0:1785787661.338322:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787661.338324:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e849e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xdc92002f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.338328:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e849e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xdc92002f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787661.338395:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+50:10475:x1872533744820864:12345-192.168.203.53@tcp:36:lhsmtool_posix.0 Request processed in 612us (858us total) trans 0 rc -2/-2 00000100:00100000:3.0:1785787661.338943:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 73 00000100:00100000:3.0:1785787661.352248:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787661.352277:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744820992 00000100:00100000:3.0:1785787661.352285:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744820992 00000100:00100000:3.0:1785787661.352333:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 74 00000100:00100000:3.0:1785787661.352341:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+50:10475:x1872533744820992:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785787661.352360:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787661.352380:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e849ef lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd3ef expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.352426:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e849f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.352438:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e849f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.352448:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e849f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.352535:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e849ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3ef expref: 52 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.352551:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e849f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3ef expref: 51 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.352559:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff919055acd900) 00010000:00010000:3.0:1785787661.352562:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1785787661.352566:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f903e00, rc 0) 00000100:00100000:3.0:1785787661.352617:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+51:10475:x1872533744820992:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 276us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787661.352634:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 74 00000100:00100000:1.0:1785787661.355522:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787661.355639:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744821248 00000100:00100000:3.0:1785787661.355647:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744821248 00000100:00100000:3.0:1785787661.355714:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 75 00000100:00100000:3.0:1785787661.355725:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+51:10475:x1872533744821248:12345-192.168.203.53@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1785787661.355805:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e849fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.355819:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e849fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.355846:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e849fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1785787661.356104:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1785787661.356113:0:5820:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 448600284005ns, next at 449600281940ns, rc = 0 00000004:00010000:3.0:1785787661.356189:0:5820:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003b974855 reply state 00000000b930b2c1 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e849fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787661.356198:0:5820:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785787661.356279:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+53:10475:x1872533744821248:12345-192.168.203.53@tcp:36:lhsmtool_posix.0 Request processed in 557us (764us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1785787661.356287:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 75 00000100:00100000:3.0:1785787661.357957:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787661.357979:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744821376 00000100:00100000:3.0:1785787661.357985:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744821376 00000100:00100000:3.0:1785787661.358018:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 76 00000100:00100000:3.0:1785787661.358026:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+53:10475:x1872533744821376:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785787661.358046:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787661.358060:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84a04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd3f6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.358114:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84a04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3f6 expref: 54 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.358127:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84a04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3f6 expref: 54 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.358146:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff919055acd900) 00010000:00010000:3.0:1785787661.358150:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785787661.358153:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f903000, rc 0) 00000100:00100000:3.0:1785787661.358188:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+54:10475:x1872533744821376:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 162us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787661.358195:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 76 00010000:00010000:0.0:1785787661.358744:0:3319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e849fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787661.358754:0:3319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e849fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787661.358761:0:3319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e849fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787661.358767:0:3319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903a00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1785787661.358771:0:3319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e849fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787661.358779:0:3319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e849fd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787661.358791:0:3319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff919055acd900) 00010000:00010000:0.0:1785787661.358794:0:3319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1785787661.358797:0:3319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e849fd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787661.358803:0:3319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e849fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787661.362770:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787661.363046:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744821504 00000100:00100000:2.0:1785787661.363054:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744821504 00000100:00100000:2.0:1785787661.363096:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 24 00000100:00100000:2.0:1785787661.363103:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ecea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2387:x1872533744821504:12345-192.168.203.53@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1785787661.363129:0:6618:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 79280304-55c6-4698-bfc3-29d14648ba45@192.168.203.53@tcp t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:2.0:1785787661.363155:0:6618:0:(genops.c:1406:class_connect()) connect: client 79280304-55c6-4698-bfc3-29d14648ba45, cookie 0xe2c2ff68a6e84a0b 00002000:00100000:2.0:1785787661.363166:0:6618:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 79280304-55c6-4698-bfc3-29d14648ba45/ffff919077851800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113801 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1785787661.363176:0:6618:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1785787661.363369:0:6618:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1785787661.363395:0:6618:0:(import.c:65:import_set_state_nolock()) ffff919077854000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1785787661.365553:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ecea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+6:2387:x1872533744821504:12345-192.168.203.53@tcp:8:lhsmtool_posix.0 Request processed in 2443us (2785us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787661.365562:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 24 00000100:00100000:3.0:1785787661.377682:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787661.377897:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744821632 00000100:00100000:0.0:1785787661.377906:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744821632 00000100:00100000:0.0:1785787661.377976:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 25 00000100:00100000:0.0:1785787661.377987:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:79280304-55c6-4698-bfc3-29d14648ba45+6:0:x1872533744821632:12345-192.168.203.53@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1785787661.378224:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785787661.446803:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:79280304-55c6-4698-bfc3-29d14648ba45+7:0:x1872533744821632:12345-192.168.203.53@tcp:2:lhsmtool_posix.0 Request processed in 68808us (69119us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1785787661.446822:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 25 00000001:00080000:0.0:1785787661.446872:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:0.0:1785787661.446883:0:7522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 79280304-55c6-4698-bfc3-29d14648ba45 00000100:00100000:0.0:1785787661.450527:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787661.450591:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744821888 00000100:00100000:1.0:1785787661.450600:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744821888 00000100:00100000:1.0:1785787661.450662:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 19 00000100:00100000:1.0:1785787661.450670:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+53:10475:x1872533744821888:12345-192.168.203.53@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1785787661.450893:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+54:10475:x1872533744821888:12345-192.168.203.53@tcp:35:lhsmtool_posix.0 Request processed in 223us (373us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1785787661.450909:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 19 00000100:00100000:0.0:1785787661.453779:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787661.453891:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744822144 00000100:00100000:1.0:1785787661.453899:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744822144 00000100:00100000:1.0:1785787661.453946:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 77 00000100:00100000:1.0:1785787661.453954:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+54:10475:x1872533744822144:12345-192.168.203.53@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1785787661.454034:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+54:10475:x1872533744822144:12345-192.168.203.53@tcp:57:lhsmtool_posix.0 Request processed in 81us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787661.454040:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 77 00000100:00100000:0.0:1785787661.459579:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787661.459699:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744822272 00000100:00100000:2.0:1785787661.459708:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744822272 00000100:00100000:2.0:1785787661.459761:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 78 00000100:00100000:2.0:1785787661.459771:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+54:10475:x1872533744822272:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1785787661.459790:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787661.459817:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84a12 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd3fd expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.459894:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d600/0xe2c2ff68a6e84a19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.459906:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d600/0xe2c2ff68a6e84a19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.459915:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d600/0xe2c2ff68a6e84a19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787661.459943:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785787661.459956:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d600/0xe2c2ff68a6e84a19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.459975:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84a12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3fd expref: 56 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.459989:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d600/0xe2c2ff68a6e84a19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3fd expref: 55 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.459997:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff919055acd900) 00010000:00010000:2.0:1785787661.459999:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1785787661.460002:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677d600, rc 0) 00000100:00100000:2.0:1785787661.460094:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+55:10475:x1872533744822272:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 324us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787661.460100:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 78 00000100:00100000:2.0:1785787661.464914:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787661.465023:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744822400 00000100:00100000:3.0:1785787661.465031:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744822400 00000100:00100000:3.0:1785787661.465154:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 26 00000100:00100000:3.0:1785787661.465163:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:79280304-55c6-4698-bfc3-29d14648ba45+5:2391:x1872533744822400:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785787661.465178:0:9394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787661.465195:0:9394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090efa3cd/0xe2c2ff68a6e84a20 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd404 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785787661.465216:0:9394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a70f50d, blocks: 0x1 00010000:00010000:3.0:1785787661.465230:0:9394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=448s v=(0 0) 00010000:00010000:3.0:1785787661.465234:0:9394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785787661.465242:0:9394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090efa3cd/0xe2c2ff68a6e84a20 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd404 expref: 6 pid: 9394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.465266:0:9394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000090efa3cd/0xe2c2ff68a6e84a20 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd404 expref: 6 pid: 9394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.465279:0:9394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f903400, rc 0) 00000100:00100000:3.0:1785787661.465329:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:79280304-55c6-4698-bfc3-29d14648ba45+6:2391:x1872533744822400:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 167us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787661.465335:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 26 00000100:00100000:3.0:1785787661.488040:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787661.488765:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744822656 00000100:00100000:0.0:1785787661.488775:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744822656 00000100:00100000:0.0:1785787661.488847:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 79 00000100:00100000:0.0:1785787661.488857:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077089880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+55:10475:x1872533744822656:12345-192.168.203.53@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1785787661.488956:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077089880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+55:10475:x1872533744822656:12345-192.168.203.53@tcp:57:lhsmtool_posix.0 Request processed in 99us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787661.488964:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 79 00000040:00080000:1.0:1785787661.495268:0:11882:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1785787661.495277:0:11882:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1785787661.495315:0:11882:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1785787661.495320:0:11882:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1785787661.504919:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787661.504989:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744822784 00000100:00100000:3.0:1785787661.504998:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744822784 00000100:00100000:3.0:1785787661.505050:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 27 00000100:00100000:3.0:1785787661.505059:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:79280304-55c6-4698-bfc3-29d14648ba45+6:10475:x1872533744822784:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785787661.505075:0:6619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787661.505090:0:6619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b3a3c20/0xe2c2ff68a6e84a27 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd40b expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.505116:0:6619:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000090efa3cd/0xe2c2ff68a6e84a20 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd404 expref: 7 pid: 9394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.505124:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785787661.505128:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785787661.505133:0:6619:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b3a3c20/0xe2c2ff68a6e84a27 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd40b expref: 7 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.505162:0:6619:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000090efa3cd/0xe2c2ff68a6e84a20 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd404 expref: 7 pid: 9394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.505182:0:6619:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000090efa3cd/0xe2c2ff68a6e84a20 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd404 expref: 7 pid: 9394 timeout: 548 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787661.505194:0:6619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907708b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6619:1872533770017792:192.168.203.53@tcp:104: 00000100:00100000:3.0:1785787661.505267:0:6619:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190469d1840 going to sleep for 11 seconds 00000100:00100000:3.0:1785787661.523342:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787661.523372:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744822912 00000100:00100000:3.0:1785787661.523380:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744822912 00010000:00010000:3.0:1785787661.523429:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000090efa3cd/0xe2c2ff68a6e84a20 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd404 expref: 8 pid: 9394 timeout: 548 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787661.523466:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 42 00000100:00100000:3.0:1785787661.523476:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051466850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79280304-55c6-4698-bfc3-29d14648ba45+8:2388:x1872533744822912:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785787661.523490:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787661.523510:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000090efa3cd/0xe2c2ff68a6e84a20 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd404 expref: 8 pid: 9394 timeout: 548 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.523524:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000090efa3cd/0xe2c2ff68a6e84a20 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd404 expref: 8 pid: 9394 timeout: 548 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.524559:0:5805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785787661.524565:0:5805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785787661.524575:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000b3a3c20/0xe2c2ff68a6e84a27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd40b expref: 8 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.524603:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b3a3c20/0xe2c2ff68a6e84a27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd40b expref: 8 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.524695:0:5805:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000b3a3c20/0xe2c2ff68a6e84a27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd40b expref: 8 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787661.524712:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077088380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5805:1872533770017920:192.168.203.53@tcp:105: 00000100:00100000:3.0:1785787661.524789:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190469d1300 going to sleep for 11 seconds 00010000:00010000:3.0:1785787661.524843:0:6619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090efa3cd/0xe2c2ff68a6e84a20 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd404 expref: 8 pid: 9394 timeout: 548 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787661.524855:0:6619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907708b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6619:1872533770017792:192.168.203.53@tcp:104: 00010000:00010000:3.0:1785787661.524878:0:6619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000b3a3c20/0xe2c2ff68a6e84a27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd40b expref: 7 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.524888:0:6619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f903200, rc 0) 00000100:00100000:3.0:1785787661.524914:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:79280304-55c6-4698-bfc3-29d14648ba45+7:10475:x1872533744822784:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 19857us (20003us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787661.524921:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 27 00000100:00100000:1.0:1785787661.533764:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077088380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5805:1872533770017920:192.168.203.53@tcp:105: 00010000:00010000:1.0:1785787661.533790:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785787661.533863:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051466850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79280304-55c6-4698-bfc3-29d14648ba45+6:2388:x1872533744822912:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 10387us (10526us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787661.533874:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 42 00000100:00100000:3.0:1785787661.539892:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787661.539924:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744823040 00000100:00100000:3.0:1785787661.539932:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744823040 00002000:00100000:3.0:1785787661.539971:0:6624:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff91907708a680 x1872533744823040/t0(0) o4->79280304-55c6-4698-bfc3-29d14648ba45@192.168.203.53@tcp:517/0 lens 504/0 e 0 to 0 dl 1785787672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785787661.539994:0:6624:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91907708a680 with x1872533744823040 ext(0->8) 00002000:00010000:3.0:1785787661.539999:0:6624:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91907708a680 00000100:00100000:3.0:1785787661.540019:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 0 00000100:00100000:3.0:1785787661.540027:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907708a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:79280304-55c6-4698-bfc3-29d14648ba45+6:2390:x1872533744823040:12345-192.168.203.53@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1785787661.540807:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907708a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:79280304-55c6-4698-bfc3-29d14648ba45+8:2390:x1872533744823040:12345-192.168.203.53@tcp:4:lhsmtool_posix.0 Request processed in 778us (920us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1785787661.540816:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 0 00002000:00100000:3.0:1785787661.540823:0:6624:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff91907708a680 x1872533744823040/t4294967302(0) o4->79280304-55c6-4698-bfc3-29d14648ba45@192.168.203.53@tcp:517/0 lens 504/448 e 0 to 0 dl 1785787672 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785787661.540862:0:6624:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91907708a680 with x1872533744823040 ext(0->8) 00002000:00010000:3.0:1785787661.540866:0:6624:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91907708a680 00000100:00100000:3.0:1785787661.557629:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787661.557862:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744823168 00000100:00100000:2.0:1785787661.557879:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744823168 00000100:00100000:2.0:1785787661.557923:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 80 00000100:00100000:2.0:1785787661.557931:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077088e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+55:10475:x1872533744823168:12345-192.168.203.53@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1785787661.631534:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967315 is committed 00000001:00080000:0.0:1785787661.631553:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000100:00100000:2.0:1785787661.631567:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077088e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+49:10475:x1872533744823168:12345-192.168.203.53@tcp:44:lhsmtool_posix.0 Request processed in 73632us (73950us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787661.631577:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 80 00000004:00080000:0.0:1785787661.631581:0:5843:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:0.0:1785787661.631597:0:5843:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91904689b240 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1785787661.631601:0:5843:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9190453e0e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91904689b0c0 00000020:00080000:0.0:1785787661.631604:0:5843:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9190453e0400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91907b6d3400 00000020:00080000:2.0:1785787661.631871:0:5854:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1785787661.631981:0:5854:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1785787661.632170:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770018048:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1785787661.632217:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1785787661.632502:0:5843:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:1.0:1785787661.632893:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785787661.632905:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bd99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770018176:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1785787661.632936:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787661.633723:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770018048 00000100:00100000:2.0:1785787661.633731:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770018048 00000100:00100000:2.0:1785787661.633872:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770018176 00000100:00100000:2.0:1785787661.633876:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770018176 00000100:00100000:2.0:1785787661.633902:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1785787661.633910:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077088a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3334:x1872533770018048:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1785787661.633938:0:6618:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1785787661.633970:0:6618:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a70f509, atime: 0x6a70f50a, ctime: 0x6a70f509, blocks: 0x1 00010000:00010000:2.0:1785787661.633977:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf7f15fa/0xe2c2ff68a6e84a2e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.633993:0:6618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=448s v=(0 0) 00010000:00010000:2.0:1785787661.633997:0:6618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785787661.634004:0:6618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf7f15fa/0xe2c2ff68a6e84a2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.634019:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf7f15fa/0xe2c2ff68a6e84a2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.634040:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf7f15fa/0xe2c2ff68a6e84a2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.634047:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf7f15fa/0xe2c2ff68a6e84a2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.634064:0:6618:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785787661.638008:0:11050:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785787661.638021:0:11050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf7f15fa/0xe2c2ff68a6e84a2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787661.638048:0:11050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677cc00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785787661.638054:0:11050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf7f15fa/0xe2c2ff68a6e84a2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787661.638064:0:11050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf7f15fa/0xe2c2ff68a6e84a2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787661.638084:0:11050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf7f15fa/0xe2c2ff68a6e84a2e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787661.638092:0:11050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf7f15fa/0xe2c2ff68a6e84a2e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787661.638116:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787661.638118:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787661.638120:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785787661.638143:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1785787661.638156:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ecc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770018176:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1785787661.638306:0:6619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1785787661.638309:0:6619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1785787661 00002000:00010000:1.0:1785787661.638311:0:6619:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1785787661.638312:0:6619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1785787661 -> 1785787661 00002000:00010000:1.0:1785787661.638314:0:6619:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1785787661.638376:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ecc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3336:x1872533770018176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 223us (5438us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1785787661.638392:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:1.0:1785787661.638457:0:3336:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91907bd99c00/2, rc 0, transno 4294967303 00000100:00100000:1.0:1785787661.638463:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bd99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770018176:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1785787661.641870:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077088a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3334:x1872533770018048:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7954us (9646us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1785787661.641883:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1785787661.646990:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787661.647492:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744823296 00000100:00100000:1.0:1785787661.647501:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744823296 00000100:00100000:1.0:1785787661.647555:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 30 00000100:00100000:1.0:1785787661.647565:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:79280304-55c6-4698-bfc3-29d14648ba45+8:2391:x1872533744823296:12345-192.168.203.53@tcp:16:lhsmtool_posix.0 00000004:00080000:3.0:1785787661.648787:0:3334:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91907fd92680/2, rc 0, transno 4294967301 00000100:00100000:3.0:1785787661.648797:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770018048:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1785787661.732986:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1785787661.733003:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:0.0:1785787661.733307:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:79280304-55c6-4698-bfc3-29d14648ba45+6:2391:x1872533744823296:12345-192.168.203.53@tcp:16:lhsmtool_posix.0 Request processed in 85738us (86318us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787661.733318:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 30 00000100:00100000:3.0:1785787661.738937:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787661.738977:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744823552 00000100:00100000:2.0:1785787661.738986:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744823552 00000100:00100000:3.0:1785787661.741453:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 81 00000100:00100000:3.0:1785787661.741471:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907708b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+13:10475:x1872533744823552:12345-192.168.203.53@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1785787661.741533:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787661.741560:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d600/0xe2c2ff68a6e84a19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3fd expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.741593:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff919055acd900) 00010000:00010000:3.0:1785787661.741597:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785787661.741631:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84a35 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.741643:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84a35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.741653:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84a35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785787661.741973:0:5820:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000036a79935 reply state 00000000c9e773f3 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84a35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787661.741983:0:5820:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785787661.742076:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907708b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+14:10475:x1872533744823552:12345-192.168.203.53@tcp:36:lhsmtool_posix.0 Request processed in 611us (3145us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1785787661.742084:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 81 00000100:00100000:2.0:1785787661.749383:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00010000:00010000:1.0:1785787661.749741:0:3320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84a35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787661.749754:0:3320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84a35 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787661.749815:0:3320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84a35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787661.749823:0:3320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f902600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787661.749849:0:3320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84a35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787661.749858:0:3320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84a35 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787661.749874:0:3320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff919055acd900) 00010000:00010000:1.0:1785787661.749877:0:3320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785787661.749882:0:3320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84a35 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787661.749888:0:3320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84a35 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787661.750016:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744823680 00000100:00100000:3.0:1785787661.750024:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744823680 00000100:00100000:3.0:1785787661.750074:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 31 00000100:00100000:3.0:1785787661.750083:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+6:2391:x1872533744823680:12345-192.168.203.53@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1785787661.750311:0:6618:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1785787661.750315:0:6618:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1785787661 -> 1785787660 00002000:00010000:3.0:1785787661.750317:0:6618:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1785787658 00002000:00010000:3.0:1785787661.750319:0:6618:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1785787661 -> 1785787660 00002000:00010000:3.0:1785787661.750321:0:6618:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1785787661.750388:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+7:2391:x1872533744823680:12345-192.168.203.53@tcp:2:lhsmtool_posix.0 Request processed in 306us (1014us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1785787661.750395:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 31 00000100:00100000:2.0:1785787661.755763:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787661.755866:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744823936 00000100:00100000:1.0:1785787661.755874:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744823936 00000100:00100000:1.0:1785787661.755927:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 82 00000100:00100000:1.0:1785787661.755937:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+13:10475:x1872533744823936:12345-192.168.203.53@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1785787661.755997:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84a3c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787661.756014:0:9295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e849f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3ef expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787661.756023:0:9295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84a3c lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787661.756053:0:9295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e849f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3ef expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787661.756065:0:9295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e849f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3ef expref: 13 pid: 5822 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787661.756078:0:9295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076ecca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9295:1872533770018304:192.168.203.53@tcp:104: 00000100:00100000:1.0:1785787661.756158:0:9295:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905159dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1785787661.758983:0:9295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076ecca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9295:1872533770018304:192.168.203.53@tcp:104: 00010000:00010000:1.0:1785787661.759009:0:9295:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84a3c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787661.761221:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787661.761582:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744824064 00000100:00100000:0.0:1785787661.761591:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744824064 00010000:00010000:0.0:1785787661.761637:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e849f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3ef expref: 14 pid: 5822 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787661.761676:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 43 00000100:00100000:0.0:1785787661.761686:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79280304-55c6-4698-bfc3-29d14648ba45+14:2391:x1872533744824064:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785787661.761700:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785787661.761707:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e849f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3ef expref: 14 pid: 5822 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787661.761719:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e849f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3ef expref: 14 pid: 5822 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787661.761742:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e849f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3ef expref: 14 pid: 5822 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787661.761757:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff919055acd900) 00010000:00010000:0.0:1785787661.761810:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84a3c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787661.761820:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84a3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787661.761908:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84a3c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787661.761962:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785787661.762012:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79280304-55c6-4698-bfc3-29d14648ba45+13:2391:x1872533744824064:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 327us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787661.762032:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 43 00010000:00010000:1.0:1785787661.764914:0:9295:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84a3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787661.764945:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84a3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787661.767497:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84a3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787661.767512:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84a3c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787661.767520:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84a3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787661.767526:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0e400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1785787661.767531:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84a3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787661.767538:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84a3c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787661.767553:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff919055acd900) 00010000:00010000:0.0:1785787661.767556:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1785787661.767559:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84a3c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787661.767564:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84a3c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787661.767654:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+12:10475:x1872533744823936:12345-192.168.203.53@tcp:55:lhsmtool_posix.0 Request processed in 11714us (11894us total) trans 0 rc -22/-22 00000100:00100000:0.0:1785787661.767663:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 82 00000100:00100000:2.0:1785787661.769916:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787661.769991:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744824192 00000100:00100000:1.0:1785787661.769999:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744824192 00000100:00100000:1.0:1785787661.770042:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 32 00000100:00100000:1.0:1785787661.770050:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:79280304-55c6-4698-bfc3-29d14648ba45+7:2391:x1872533744824192:12345-192.168.203.53@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1785787661.770089:0:6617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005f57a774/0xe2c2ff68a6e84a43 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787661.770109:0:6617:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000b3a3c20/0xe2c2ff68a6e84a27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd40b expref: 7 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787661.770117:0:6617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1785787661.770121:0:6617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1785787661.770126:0:6617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f57a774/0xe2c2ff68a6e84a43 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787661.770158:0:6617:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000b3a3c20/0xe2c2ff68a6e84a27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd40b expref: 7 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787661.770171:0:6617:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000b3a3c20/0xe2c2ff68a6e84a27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd40b expref: 7 pid: 6619 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787661.770183:0:6617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076ecca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6617:1872533770018432:192.168.203.53@tcp:104: 00000100:00100000:1.0:1785787661.770253:0:6617:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905159dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1785787661.780382:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787661.780415:0:6617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076ecca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6617:1872533770018432:192.168.203.53@tcp:104: 00010000:00010000:1.0:1785787661.780441:0:6617:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005f57a774/0xe2c2ff68a6e84a43 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787661.780532:0:11051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744824320 00000100:00100000:3.0:1785787661.780539:0:11051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744824320 00010000:00010000:3.0:1785787661.780575:0:11051:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000b3a3c20/0xe2c2ff68a6e84a27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd40b expref: 8 pid: 6619 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787661.781015:0:11051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 44 00000100:00100000:3.0:1785787661.781025:0:11051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79280304-55c6-4698-bfc3-29d14648ba45+8:2391:x1872533744824320:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785787661.781038:0:11051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787661.781057:0:11051:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000b3a3c20/0xe2c2ff68a6e84a27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd40b expref: 8 pid: 6619 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.781069:0:11051:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000b3a3c20/0xe2c2ff68a6e84a27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd40b expref: 8 pid: 6619 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.781101:0:11051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b3a3c20/0xe2c2ff68a6e84a27 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd40b expref: 8 pid: 6619 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.781114:0:11051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1785787661.781117:0:11051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1785787661.781122:0:11051:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005f57a774/0xe2c2ff68a6e84a43 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.781131:0:11051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f57a774/0xe2c2ff68a6e84a43 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.781169:0:11051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787661.781213:0:11051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79280304-55c6-4698-bfc3-29d14648ba45+7:2391:x1872533744824320:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 189us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787661.781220:0:11051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 44 00010000:00010000:3.0:1785787661.781251:0:6617:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005f57a774/0xe2c2ff68a6e84a43 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.781259:0:6617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f57a774/0xe2c2ff68a6e84a43 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.781281:0:6617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005f57a774/0xe2c2ff68a6e84a43 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.781289:0:6617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f57a774/0xe2c2ff68a6e84a43 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.781297:0:6617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f57a774/0xe2c2ff68a6e84a43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.781305:0:6617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0f400 already unused, calling callback (ffffffffc174c300) 00010000:00010000:3.0:1785787661.781309:0:6617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f57a774/0xe2c2ff68a6e84a43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.781318:0:6617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f57a774/0xe2c2ff68a6e84a43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.781341:0:6617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f57a774/0xe2c2ff68a6e84a43 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.781349:0:6617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f57a774/0xe2c2ff68a6e84a43 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787661.781391:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:79280304-55c6-4698-bfc3-29d14648ba45+6:2391:x1872533744824192:12345-192.168.203.53@tcp:1:lhsmtool_posix.0 Request processed in 11341us (11480us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787661.781398:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 32 00000100:00100000:3.0:1785787661.784390:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787661.787042:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744824576 00000100:00100000:1.0:1785787661.787053:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744824576 00000100:00100000:1.0:1785787661.787109:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 83 00000100:00100000:1.0:1785787661.787119:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077088000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+12:10475:x1872533744824576:12345-192.168.203.53@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1785787661.787195:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84a4a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787661.787211:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84a4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787661.787223:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84a4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787661.787399:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84a51 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787661.787410:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84a04 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3f6 expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787661.787418:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84a51 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787661.787449:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84a04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3f6 expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787661.787463:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84a04 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3f6 expref: 13 pid: 5822 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787661.787491:0:5821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076ecca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5821:1872533770018560:192.168.203.53@tcp:104: 00000100:00100000:1.0:1785787661.787567:0:5821:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905159dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1785787661.791583:0:5821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076ecca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5821:1872533770018560:192.168.203.53@tcp:104: 00010000:00010000:1.0:1785787661.792027:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84a51 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787661.794376:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787661.794448:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744824704 00000100:00100000:0.0:1785787661.794470:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744824704 00010000:00010000:0.0:1785787661.794508:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84a04 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3f6 expref: 14 pid: 5822 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787661.794544:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 45 00000100:00100000:0.0:1785787661.794553:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907708aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79280304-55c6-4698-bfc3-29d14648ba45+14:2391:x1872533744824704:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785787661.794568:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785787661.794575:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84a04 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3f6 expref: 14 pid: 5822 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787661.794589:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84a04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3f6 expref: 14 pid: 5822 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787661.794652:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84a04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3f6 expref: 14 pid: 5822 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787661.794669:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff919055acd900) 00010000:00010000:0.0:1785787661.794673:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84a51 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787661.794682:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84a51 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787661.794689:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84a51 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787661.794717:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785787661.794772:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907708aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79280304-55c6-4698-bfc3-29d14648ba45+13:2391:x1872533744824704:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 209us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787661.794796:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 45 00010000:00010000:2.0:1785787661.794818:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84a51 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.794826:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84a51 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785787661.795014:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1785787661.795162:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1785787661.795210:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1785787661.795283:0:5821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd93800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5821:1872533770018688:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1785787661.795334:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787661.795372:0:5821:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190515b7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1785787661.795550:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770018688 00000100:00100000:0.0:1785787661.795555:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770018688 00000100:00100000:0.0:1785787661.795585:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1785787661.795592:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5821:x1872533770018688:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1785787661.795911:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5821:x1872533770018688:12345-0@lo:1000:mdt00_001.0 Request processed in 319us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787661.795919:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1785787661.796690:0:5821:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1785787661.796696:0:5821:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91907bd99c00, transno 4294967303 00000100:00100000:2.0:1785787661.796716:0:5821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd93800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5821:1872533770018688:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1785787661.797175:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1785787661.797234:0:5821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd93800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5821:1872533770018816:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1785787661.797270:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787661.797295:0:5821:0:(client.c:2702:ptlrpc_set_wait()) set ffff919042b4b000 going to sleep for 11 seconds 00000100:00100000:0.0:1785787661.797486:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770018816 00000100:00100000:0.0:1785787661.797492:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770018816 00000100:00100000:0.0:1785787661.797528:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1785787661.797536:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5821:x1872533770018816:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1785787661.797958:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5821:x1872533770018816:12345-0@lo:1000:mdt00_001.0 Request processed in 422us (687us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1785787661.797966:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1785787661.798994:0:5821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd93800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5821:1872533770018816:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1785787661.799029:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84a51 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.799039:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84a51 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.799047:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84a51 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.799053:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0e400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787661.799057:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84a51 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.799065:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84a51 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.799079:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff919055acd900) 00010000:00010000:2.0:1785787661.799082:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1785787661.799086:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84a51 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.799104:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84a51 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.799139:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e8497f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.799146:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e8497f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.799153:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e8497f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.799159:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0ea00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787661.799161:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e8497f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.799167:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e8497f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.799174:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91905685f900) 00010000:00010000:2.0:1785787661.799176:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1785787661.799178:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e8497f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.799184:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e8497f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.799201:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84a58 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.799212:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e8499b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3da expref: 16 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.799225:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84a58 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.799252:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e8499b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3da expref: 16 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.799266:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e8499b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3da expref: 16 pid: 5820 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787661.799278:0:5821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5821:1872533770018944:192.168.203.53@tcp:104: 00000100:00100000:2.0:1785787661.799421:0:5821:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905593a840 going to sleep for 11 seconds 00000100:00100000:3.0:1785787661.806617:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787661.806686:0:11051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744824832 00000100:00100000:0.0:1785787661.806695:0:11051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744824832 00000100:00100000:2.0:1785787661.806717:0:5821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5821:1872533770018944:192.168.203.53@tcp:104: 00010000:00010000:0.0:1785787661.806730:0:11051:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e8499b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3da expref: 17 pid: 5820 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.806739:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84a58 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787661.806780:0:11051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 46 00000100:00100000:0.0:1785787661.806790:0:11051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077088380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79280304-55c6-4698-bfc3-29d14648ba45+17:2390:x1872533744824832:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785787661.806815:0:11051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785787661.806823:0:11051:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e8499b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3da expref: 17 pid: 5820 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787661.806879:0:11051:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e8499b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3da expref: 17 pid: 5820 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787661.806900:0:11051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e8499b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd3da expref: 17 pid: 5820 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787661.806914:0:11051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91905685f900) 00010000:00010000:0.0:1785787661.806919:0:11051:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84a58 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787661.806928:0:11051:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84a58 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787661.806935:0:11051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84a58 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787661.806960:0:11051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785787661.807008:0:11051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077088380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79280304-55c6-4698-bfc3-29d14648ba45+16:2390:x1872533744824832:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 219us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787661.807016:0:11051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 46 00010000:00010000:2.0:1785787661.807017:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84a58 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.807023:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84a58 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.807034:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84a58 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.807041:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84a58 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.807048:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84a58 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.807063:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677d000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787661.807067:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84a58 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.807074:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84a58 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.807084:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91905685f900) 00010000:00010000:2.0:1785787661.807087:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787661.807091:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84a58 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.807097:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84a58 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.807108:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84a4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.807114:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84a4a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.807121:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84a4a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.807125:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0fe00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787661.807128:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84a4a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.807134:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84a4a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.807152:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91905685f900) 00010000:00010000:2.0:1785787661.807154:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1785787661.807158:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84a4a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787661.807163:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84a4a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787661.807349:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077088000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+15:10475:x1872533744824576:12345-192.168.203.53@tcp:57:lhsmtool_posix.0 Request processed in 20231us (22965us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1785787661.807357:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 83 00000020:00080000:2.0:1785787661.807361:0:5821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1785787661.808004:0:11564:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1785787661.808009:0:11564:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1785787661.808037:0:11564:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1785787661.808043:0:11564:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1785787661.809348:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787661.809459:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744825088 00000100:00100000:1.0:1785787661.809466:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744825088 00000100:00100000:1.0:1785787661.809522:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 20 00000100:00100000:1.0:1785787661.809530:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ec9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+15:10475:x1872533744825088:12345-192.168.203.53@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1785787661.810109:0:5823:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1785787661.810210:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1785787661.810252:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84a5f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787661.810267:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84a5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787661.810278:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84a5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787661.810286:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84a5f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787661.810303:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84a5f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787661.810309:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84a5f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787661.810332:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1785787661.810418:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ec9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+17:10475:x1872533744825088:12345-192.168.203.53@tcp:35:lhsmtool_posix.0 Request processed in 888us (1073us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1785787661.810426:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 20 00000020:00080000:1.0:1785787661.810430:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1785787661.810570:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785787661.810585:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84a5f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.810592:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0fa00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:3.0:1785787661.810596:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84a5f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.810605:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84a5f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.810616:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91905685f800) 00010000:00010000:3.0:1785787661.810627:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1785787661.810631:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84a5f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.810643:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84a5f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787661.810658:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787661.810660:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787661.810661:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787661.811996:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787662.774268:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076ec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770019072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785787662.774330:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787662.774431:0:8140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770019072 00000100:00100000:3.0:1785787662.774438:0:8140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770019072 00000100:00100000:3.0:1785787662.774498:0:8140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1785787662.774508:0:8140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3336:x1872533770019072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785787662.774538:0:8140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785787662.774594:0:8140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3336:x1872533770019072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787662.774602:0:8140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1785787662.774632:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785787662.774651:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076ec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770019072:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1785787662.837825:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1785787663.329730:0:6642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:1.0:1785787663.329749:0:6642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00080000:1.0:1785787663.329754:0:6642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000040:00080000:2.0:1785787663.536897:0:11934:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1785787663.536905:0:11934:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1785787663.536935:0:11934:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1785787663.536939:0:11934:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1785787663.684341:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787663.684376:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744825344 00000100:00100000:3.0:1785787663.684385:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744825344 00000100:00100000:3.0:1785787663.684439:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 84 00000100:00100000:3.0:1785787663.684450:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ec8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+17:10493:x1872533744825344:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:3.0:1785787663.684474:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787663.684494:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e84a66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd412 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.684792:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903400/0xe2c2ff68a6e84a6d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.684806:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903400/0xe2c2ff68a6e84a6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.684817:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903400/0xe2c2ff68a6e84a6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785787663.684902:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1785787663.685061:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e84a66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd412 expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.685078:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903400/0xe2c2ff68a6e84a6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd412 expref: 19 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.685086:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9190481f9e00) 00010000:00010000:3.0:1785787663.685089:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1785787663.685093:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f903400, rc 0) 00000100:00100000:3.0:1785787663.685141:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ec8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+19:10493:x1872533744825344:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 694us (808us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1785787663.685148:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 84 00000100:00080000:3.0:1785787663.685167:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785787663.698310:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787663.698340:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744825472 00000100:00100000:3.0:1785787663.698348:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744825472 00000100:00100000:3.0:1785787663.698392:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 85 00000100:00100000:3.0:1785787663.698402:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+19:10493:x1872533744825472:12345-192.168.203.53@tcp:34:lfs.0 00010000:00010000:3.0:1785787663.699547:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84a7b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.699564:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84a7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.699576:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84a7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.699593:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e84a82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.699654:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e84a82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.699662:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e84a82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.700167:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84a89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.700176:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84a89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.700183:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84a89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785787663.700222:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84a89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.700234:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84a7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.700249:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84a7b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.700256:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84a7b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.700262:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787663.700265:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84a7b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.700272:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84a7b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.700283:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9190481f9e00) 00010000:00010000:3.0:1785787663.700286:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787663.700290:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84a7b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.700296:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84a7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.700307:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e84a82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.700312:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e84a82 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.700318:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e84a82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.700322:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787663.700329:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e84a82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.700335:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e84a82 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.700342:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff919055acdd00) 00010000:00010000:3.0:1785787663.700344:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787663.700346:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e84a82 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.700351:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e84a82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.700365:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84a89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.700371:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84a89 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.700376:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84a89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.700381:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787663.700384:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84a89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.700390:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84a89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.700397:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff919055acd300) 00010000:00010000:3.0:1785787663.700400:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787663.700408:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84a89 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.700413:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84a89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787663.701566:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+19:10493:x1872533744825472:12345-192.168.203.53@tcp:34:lfs.0 Request processed in 3159us (3258us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787663.701577:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 85 00000100:00100000:3.0:1785787663.786078:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787663.786682:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744825728 00000100:00100000:2.0:1785787663.786691:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744825728 00000100:00100000:2.0:1785787663.786751:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 86 00000100:00100000:2.0:1785787663.786760:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+19:10496:x1872533744825728:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:2.0:1785787663.786777:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787663.786795:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e84a90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd419 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787663.786891:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84a97 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787663.786905:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84a97 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787663.786929:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84a97 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787663.786944:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84a9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787663.786952:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84a9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787663.786959:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84a9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787663.787230:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84aa5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787663.787237:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787663.787244:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787663.787251:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1785787663.787329:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84a97 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787663.787336:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84a97 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787663.787342:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84a97 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787663.787346:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677d000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787663.787355:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84a97 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787663.787361:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84a97 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787663.787371:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9190481f9e00) 00010000:00010000:2.0:1785787663.787374:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787663.787378:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84a97 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787663.787384:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84a97 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787663.787395:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84a9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787663.787399:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84a9e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787663.787404:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84a9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787663.787408:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677d800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787663.787411:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84a9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787663.787415:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84a9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787663.787420:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9190481f9c00) 00010000:00010000:2.0:1785787663.787421:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787663.787427:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84a9e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787663.787432:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84a9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787663.787462:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e84a90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd419 expref: 22 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787663.787472:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84aa5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd419 expref: 21 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787663.787478:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9190481f9700) 00010000:00010000:2.0:1785787663.787481:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785787663.787483:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677d200, rc 0) 00000100:00100000:2.0:1785787663.787537:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+21:10496:x1872533744825728:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 779us (1467us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1785787663.787543:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 86 00000100:00100000:1.0:1785787663.794149:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787663.794221:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744825856 00000100:00100000:3.0:1785787663.794230:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744825856 00000100:00100000:3.0:1785787663.794285:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 87 00000100:00100000:3.0:1785787663.794294:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+21:10496:x1872533744825856:12345-192.168.203.53@tcp:54:lfs.0 00010000:00010000:3.0:1785787663.794351:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84ab3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.794365:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.794375:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.794398:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.794404:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84ab3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.794411:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.794431:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787663.794435:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.794442:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84ab3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.794452:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9190481f9700) 00010000:00010000:3.0:1785787663.794455:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785787663.794459:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84ab3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.794466:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84ab3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787663.794540:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+21:10496:x1872533744825856:12345-192.168.203.53@tcp:54:lfs.0 Request processed in 247us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787663.794547:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 87 00000100:00100000:3.0:1785787663.796652:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787663.796752:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744826112 00000100:00100000:0.0:1785787663.796759:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744826112 00000100:00100000:0.0:1785787663.796805:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 21 00000100:00100000:0.0:1785787663.796814:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190451bf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+21:10496:x1872533744826112:12345-192.168.203.53@tcp:35:lfs.0 00000100:00100000:0.0:1785787663.797016:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190451bf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+22:10496:x1872533744826112:12345-192.168.203.53@tcp:35:lfs.0 Request processed in 203us (367us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1785787663.797023:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 21 00000100:00100000:3.0:1785787663.827781:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787663.831706:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744826368 00000100:00100000:1.0:1785787663.831720:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744826368 00000100:00100000:1.0:1785787663.831781:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 88 00000100:00100000:1.0:1785787663.831791:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+22:10016:x1872533744826368:12345-192.168.203.53@tcp:101:bash.0 00010000:00010000:1.0:1785787663.831823:0:9295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787663.831874:0:9295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84aba lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd420 expref: -99 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787663.831970:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84ac1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787663.831985:0:9295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84aa5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd419 expref: 23 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787663.832011:0:9295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84ac1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787663.832043:0:9295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84aa5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd419 expref: 23 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787663.832057:0:9295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84aa5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd419 expref: 23 pid: 5822 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787663.832071:0:9295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076ecd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9295:1872533770019200:192.168.203.53@tcp:104: 00000100:00100000:1.0:1785787663.832166:0:9295:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905159d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785787663.834202:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787663.834424:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744826496 00000100:00100000:0.0:1785787663.834431:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744826496 00010000:00010000:0.0:1785787663.834465:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84aa5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd419 expref: 24 pid: 5822 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787663.834504:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 47 00000100:00100000:0.0:1785787663.834513:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79280304-55c6-4698-bfc3-29d14648ba45+24:2390:x1872533744826496:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785787663.834526:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785787663.834532:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84aa5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd419 expref: 24 pid: 5822 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787663.834544:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84aa5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd419 expref: 24 pid: 5822 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787663.834562:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9190481f9700) 00010000:00010000:0.0:1785787663.834567:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84ac1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787663.834575:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84ac1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787663.834582:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84ac1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787663.834612:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785787663.834652:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79280304-55c6-4698-bfc3-29d14648ba45+24:2390:x1872533744826496:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 140us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787663.834659:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 47 00010000:00010000:1.0:1785787663.835938:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84aa5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd419 expref: 23 pid: 5822 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787663.835956:0:9295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076ecd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9295:1872533770019200:192.168.203.53@tcp:104: 00010000:00010000:1.0:1785787663.835977:0:9295:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84ac1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787663.835985:0:9295:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84ac1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787663.835990:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84ac1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785787663.836008:0:9295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1785787663.836131:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84aba lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd420 expref: 24 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787663.836160:0:9295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84ac1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd420 expref: 23 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787663.836167:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9190481f9700) 00010000:00010000:1.0:1785787663.836170:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1785787663.836173:0:9295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919043c0e400, rc 0) 00000100:00100000:1.0:1785787663.836213:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+23:10016:x1872533744826368:12345-192.168.203.53@tcp:101:bash.0 Request processed in 4423us (8440us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1785787663.836220:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 88 00000100:00100000:3.0:1785787663.842257:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787663.842343:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744826752 00000100:00100000:0.0:1785787663.842363:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744826752 00000100:00100000:0.0:1785787663.842419:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 89 00000100:00100000:0.0:1785787663.842428:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+23:10016:x1872533744826752:12345-192.168.203.53@tcp:36:bash.0 00010000:00010000:0.0:1785787663.842781:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919050678c00/0xe2c2ff68a6e84acf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787663.842798:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919050678c00/0xe2c2ff68a6e84acf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787663.842810:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919050678c00/0xe2c2ff68a6e84acf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785787663.842985:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1785787663.843012:0:5820:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004fbc4675 reply state 000000001b9119c3 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff919050678c00/0xe2c2ff68a6e84acf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787663.843021:0:5820:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1785787663.843065:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1785787663.843157:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+27:10016:x1872533744826752:12345-192.168.203.53@tcp:36:bash.0 Request processed in 729us (907us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1785787663.843164:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 89 00000020:00080000:0.0:1785787663.843168:0:5820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1785787663.846088:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00010000:00010000:0.0:1785787663.846197:0:3319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919050678c00/0xe2c2ff68a6e84acf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787663.846208:0:3319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919050678c00/0xe2c2ff68a6e84acf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787663.846215:0:3319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919050678c00/0xe2c2ff68a6e84acf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787663.846221:0:3319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919050678c00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1785787663.846236:0:3319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919050678c00/0xe2c2ff68a6e84acf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787663.846244:0:3319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919050678c00/0xe2c2ff68a6e84acf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787663.846258:0:3319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9190481f9700) 00010000:00010000:0.0:1785787663.846261:0:3319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785787663.846265:0:3319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919050678c00/0xe2c2ff68a6e84acf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787663.846271:0:3319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919050678c00/0xe2c2ff68a6e84acf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787663.850756:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744826880 00000100:00100000:1.0:1785787663.850769:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744826880 00000100:00100000:1.0:1785787663.850951:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 90 00000100:00100000:1.0:1785787663.850962:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+26:10016:x1872533744826880:12345-192.168.203.53@tcp:101:bash.0 00010000:00010000:1.0:1785787663.850985:0:9295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787663.851006:0:9295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84ad6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd427 expref: -99 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787663.851063:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84ad6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd427 expref: 27 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787663.851079:0:9295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84ad6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd427 expref: 27 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787663.851099:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9190481f9700) 00010000:00010000:1.0:1785787663.851103:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1785787663.851118:0:9295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919043c0ea00, rc 0) 00000100:00100000:1.0:1785787663.851180:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+27:10016:x1872533744826880:12345-192.168.203.53@tcp:101:bash.0 Request processed in 220us (5097us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787663.851188:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 90 00000100:00100000:3.0:1785787663.855244:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787663.855316:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744827008 00000100:00100000:2.0:1785787663.855325:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744827008 00000100:00100000:2.0:1785787663.855395:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 33 00000100:00100000:2.0:1785787663.855405:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:79280304-55c6-4698-bfc3-29d14648ba45+6:10016:x1872533744827008:12345-192.168.203.53@tcp:101:bash.0 00010000:00010000:2.0:1785787663.855421:0:9394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787663.855442:0:9394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078014ab1/0xe2c2ff68a6e84add lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd42e expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785787663.855465:0:9394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a70f50c, atime: 0x6a70f50a, ctime: 0x6a70f50c, blocks: 0xb 00010000:00010000:2.0:1785787663.855490:0:9394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=451s v=(0 0) 00010000:00010000:2.0:1785787663.855506:0:9394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785787663.855513:0:9394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078014ab1/0xe2c2ff68a6e84add lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd42e expref: 7 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787663.855530:0:9394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000078014ab1/0xe2c2ff68a6e84add lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd42e expref: 7 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787663.855541:0:9394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677ce00, rc 0) 00000100:00100000:2.0:1785787663.855583:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:79280304-55c6-4698-bfc3-29d14648ba45+7:10016:x1872533744827008:12345-192.168.203.53@tcp:101:bash.0 Request processed in 180us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787663.855590:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 33 00000100:00080000:3.0:1785787663.855673:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785787663.858057:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787663.858127:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744827136 00000100:00100000:0.0:1785787663.858135:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744827136 00002000:00010000:0.0:1785787663.858169:0:6622:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1785787663.858174:0:6622:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91905267dc00 with x1872533744827136 ext(0->18446744073709551615) 00002000:00010000:0.0:1785787663.858184:0:6622:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91905267dc00. 00000100:00100000:0.0:1785787663.858212:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 1 00000100:00100000:0.0:1785787663.858219:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905267dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:79280304-55c6-4698-bfc3-29d14648ba45+7:2391:x1872533744827136:12345-192.168.203.53@tcp:10:bash.0 00002000:00010000:0.0:1785787663.858490:0:6622:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1785787663.858494:0:6622:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1785787660 -> 1785787664 00002000:00010000:0.0:1785787663.858497:0:6622:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1785787658 -> 1785787658 00002000:00010000:0.0:1785787663.858500:0:6622:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1785787660 -> 1785787664 00002000:00010000:0.0:1785787663.858502:0:6622:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1785787663.858555:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905267dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:79280304-55c6-4698-bfc3-29d14648ba45+8:2391:x1872533744827136:12345-192.168.203.53@tcp:10:bash.0 Request processed in 336us (504us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1785787663.858563:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 1 00002000:00010000:0.0:1785787663.858578:0:6622:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1785787663.858581:0:6622:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91905267dc00 with x1872533744827136 ext(0->18446744073709551615) 00002000:00010000:0.0:1785787663.858586:0:6622:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91905267dc00. 00010000:00010000:3.0:1785787663.859082:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787663.970006:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787663.970112:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744827264 00000100:00100000:2.0:1785787663.970121:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744827264 00000100:00100000:2.0:1785787663.970176:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 91 00000100:00100000:2.0:1785787663.970186:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905267ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+27:10510:x1872533744827264:12345-192.168.203.53@tcp:34:lfs.0 00010000:00010000:2.0:1785787663.970251:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84ae4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787663.970268:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84ae4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787663.970280:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84ae4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787663.970296:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84aeb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787663.970302:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84aeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787663.970326:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84aeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787663.970794:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84af2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787663.970805:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84af2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787663.970812:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84af2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785787663.974025:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84af2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.974060:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84ae4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.974068:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84ae4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.974076:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84ae4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.974082:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677d800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787663.974087:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84ae4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.974094:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84ae4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.974108:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9190481f9e00) 00010000:00010000:3.0:1785787663.974111:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787663.974115:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84ae4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.974121:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84ae4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.974138:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84aeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.974144:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84aeb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.974149:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84aeb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.974159:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677d000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787663.974162:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84aeb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.974168:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84aeb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.974175:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9190481f9900) 00010000:00010000:3.0:1785787663.974178:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787663.974180:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84aeb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.974186:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84aeb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.974200:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84af2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.974205:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84af2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.974211:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84af2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.974215:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677da00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787663.974217:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84af2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.974222:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84af2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.974236:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9190481f9700) 00010000:00010000:3.0:1785787663.974239:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787663.974242:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84af2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787663.974247:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84af2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787663.974711:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905267ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+27:10510:x1872533744827264:12345-192.168.203.53@tcp:34:lfs.0 Request processed in 4522us (4709us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787663.974721:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 91 00000100:00100000:1.0:1785787664.043036:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787664.043165:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744827520 00000100:00100000:2.0:1785787664.043175:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744827520 00000100:00100000:2.0:1785787664.043233:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 92 00000100:00100000:2.0:1785787664.043243:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+27:10514:x1872533744827520:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:2.0:1785787664.043264:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787664.043284:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d600/0xe2c2ff68a6e84af9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd435 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.043354:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84b00 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.043368:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84b00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.043378:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84b00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.043394:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84b07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.043413:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84b07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.043420:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84b07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.044122:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84b0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.044132:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84b0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.044140:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84b0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787664.044151:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1785787664.044243:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84b00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.044250:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84b00 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.044257:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84b00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.044263:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677dc00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787664.044267:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84b00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.044274:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84b00 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.044296:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9190481f9e00) 00010000:00010000:2.0:1785787664.044299:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787664.044304:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84b00 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.044311:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84b00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.044323:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84b07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.044329:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84b07 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.044336:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84b07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.044341:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677cc00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787664.044344:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84b07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.044350:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84b07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.044357:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9190481f9b00) 00010000:00010000:2.0:1785787664.044360:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787664.044363:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84b07 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.044368:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84b07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.044418:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d600/0xe2c2ff68a6e84af9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd435 expref: 30 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.044430:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84b0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd435 expref: 29 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.044437:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9190481f9700) 00010000:00010000:2.0:1785787664.044439:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1785787664.044442:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677da00, rc 0) 00000100:00100000:2.0:1785787664.045818:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+29:10514:x1872533744827520:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 2569us (2783us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1785787664.045903:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 92 00000100:00100000:0.0:1785787664.055159:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787664.055245:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744827648 00000100:00100000:3.0:1785787664.055255:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744827648 00000100:00100000:3.0:1785787664.055314:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 93 00000100:00100000:3.0:1785787664.055325:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+29:10514:x1872533744827648:12345-192.168.203.53@tcp:54:lfs.0 00010000:00010000:3.0:1785787664.055389:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84b1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787664.055405:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84ac1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd420 expref: 29 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787664.055414:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84b1c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787664.055449:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84ac1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd420 expref: 29 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787664.055463:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84ac1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd420 expref: 29 pid: 9295 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787664.055491:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905267d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5820:1872533770019328:192.168.203.53@tcp:104: 00000100:00100000:3.0:1785787664.055596:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190507db540 going to sleep for 11 seconds 00000100:00100000:0.0:1785787664.059068:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905267d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5820:1872533770019328:192.168.203.53@tcp:104: 00010000:00010000:0.0:1785787664.059095:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84b1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787664.062938:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787664.063231:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744827904 00000100:00100000:3.0:1785787664.063240:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744827904 00000100:00100000:3.0:1785787664.063301:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 22 00000100:00100000:3.0:1785787664.063310:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+30:5608:x1872533744827904:12345-192.168.203.53@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1785787664.063636:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+31:5608:x1872533744827904:12345-192.168.203.53@tcp:35:ldlm_bl.0 Request processed in 326us (705us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1785787664.063644:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 22 00000100:00100000:3.0:1785787664.069823:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787664.070005:0:11051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744828032 00000100:00100000:0.0:1785787664.070014:0:11051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744828032 00010000:00010000:0.0:1785787664.070052:0:11051:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84ac1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd420 expref: 31 pid: 9295 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787664.070094:0:11051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 48 00000100:00100000:0.0:1785787664.070102:0:11051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905267e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79280304-55c6-4698-bfc3-29d14648ba45+31:2390:x1872533744828032:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785787664.070117:0:11051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785787664.070124:0:11051:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84ac1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd420 expref: 31 pid: 9295 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.070136:0:11051:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84ac1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd420 expref: 31 pid: 9295 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.070157:0:11051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84ac1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd420 expref: 31 pid: 9295 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.070172:0:11051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9190481f9700) 00010000:00010000:0.0:1785787664.070190:0:11051:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84b1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.070201:0:11051:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84b1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.070208:0:11051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84b1c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.070239:0:11051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785787664.070298:0:11051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905267e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79280304-55c6-4698-bfc3-29d14648ba45+30:2390:x1872533744828032:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 196us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787664.070306:0:11051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 48 00010000:00010000:3.0:1785787664.070425:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84b1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787664.070434:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84b1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787664.070466:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84b1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787664.070485:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84b1c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787664.070492:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84b1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787664.070499:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787664.070504:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84b1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787664.070520:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84b1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787664.070530:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9190481f9700) 00010000:00010000:3.0:1785787664.070533:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785787664.070537:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84b1c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787664.070543:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84b1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787664.070593:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+29:10514:x1872533744827648:12345-192.168.203.53@tcp:54:lfs.0 Request processed in 15271us (15443us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787664.070609:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 93 00000100:00100000:3.0:1785787664.079491:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787664.079588:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744828288 00000100:00100000:0.0:1785787664.079596:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744828288 00000100:00100000:0.0:1785787664.079662:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 23 00000100:00100000:0.0:1785787664.079672:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905267d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+29:10514:x1872533744828288:12345-192.168.203.53@tcp:35:lfs.0 00000100:00100000:0.0:1785787664.079913:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905267d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+30:10514:x1872533744828288:12345-192.168.203.53@tcp:35:lfs.0 Request processed in 242us (428us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1785787664.079921:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 23 00000100:00100000:0.0:1785787664.200761:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787664.203889:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744828544 00000100:00100000:1.0:1785787664.203903:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744828544 00000100:00100000:1.0:1785787664.204016:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 94 00000100:00100000:1.0:1785787664.204027:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+30:10525:x1872533744828544:12345-192.168.203.53@tcp:101:cat.0 00010000:00010000:1.0:1785787664.204051:0:9295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787664.204073:0:9295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84b23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd43c expref: -99 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.204142:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e84b2a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.204157:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e84b2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.204168:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e84b2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.204182:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84b31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.204189:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84b31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.204195:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84b31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.204500:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84b38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.204510:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84b38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.204517:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84b38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785787664.204527:0:9295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1785787664.204629:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e84b2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.204637:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e84b2a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.204644:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e84b2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.204650:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0f400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787664.204655:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e84b2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.204663:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e84b2a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.204675:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9190481f9e00) 00010000:00010000:1.0:1785787664.204678:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785787664.204683:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e84b2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.204699:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e84b2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.204711:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84b31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.204718:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84b31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.204724:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84b31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.204729:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0fe00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787664.204732:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84b31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.204738:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84b31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.204746:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91905685f300) 00010000:00010000:1.0:1785787664.204749:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785787664.204751:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84b31 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.204758:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84b31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.204797:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84b23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd43c expref: 33 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.204811:0:9295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84b38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd43c expref: 32 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.204824:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9190481f9700) 00010000:00010000:1.0:1785787664.204868:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785787664.204872:0:9295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919043c0fa00, rc 0) 00000100:00100000:1.0:1785787664.204942:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+32:10525:x1872533744828544:12345-192.168.203.53@tcp:101:cat.0 Request processed in 917us (4190us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1785787664.204949:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 94 00000100:00100000:2.0:1785787664.216849:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787664.217083:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744828800 00000100:00100000:0.0:1785787664.217093:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744828800 00000100:00100000:0.0:1785787664.217158:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 24 00000100:00100000:0.0:1785787664.217168:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+32:10525:x1872533744828800:12345-192.168.203.53@tcp:35:cat.0 00000100:00100000:0.0:1785787664.217398:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+33:10525:x1872533744828800:12345-192.168.203.53@tcp:35:cat.0 Request processed in 231us (570us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1785787664.217406:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 24 00000100:00100000:0.0:1785787664.256403:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787664.256496:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744829056 00000100:00100000:2.0:1785787664.256506:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744829056 00000100:00100000:2.0:1785787664.256566:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 95 00000100:00100000:2.0:1785787664.256576:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+33:10526:x1872533744829056:12345-192.168.203.53@tcp:36:rm.0 00010000:00010000:2.0:1785787664.256639:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1785787664.256665:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84b38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd43c expref: 33 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.256688:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84b0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd435 expref: 32 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.256702:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84ad6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd427 expref: 31 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.256732:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9190481f9700) 00010000:00010000:2.0:1785787664.256742:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785787664.256761:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84b46 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.256774:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84b46 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.256783:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84b46 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.256796:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84b4d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.256803:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84b4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.256810:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84b4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.257244:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84b54 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.257254:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84b54 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.257262:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84b54 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785787664.257875:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1785787664.257884:0:5821:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 451502055401ns, next at 452502053334ns, rc = 0 00010000:00010000:2.0:1785787664.257950:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84b5b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.257960:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84b5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.257968:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84b5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.257976:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84b5b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.257982:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84b5b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.257989:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84b5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.258018:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785787664.258035:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84b54 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.258042:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84b54 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.258049:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84b54 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.258055:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677d200 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787664.258059:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84b54 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.258067:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84b54 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.258293:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785787664.258300:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84b5b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.258306:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677ca00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:0.0:1785787664.258309:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84b5b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.258315:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84b5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.258324:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9190481f9900) 00010000:00010000:0.0:1785787664.258327:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1785787664.258331:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84b5b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.258336:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84b5b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.258347:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787664.258349:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787664.258351:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787664.258912:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9190481f9900) 00010000:00010000:2.0:1785787664.258914:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785787664.258918:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84b54 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.258923:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84b54 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.258942:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84b46 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.258948:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84b46 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.258953:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84b46 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.258958:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677d000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787664.258960:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84b46 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.258965:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84b46 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.258971:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9190481f9e00) 00010000:00010000:2.0:1785787664.258973:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787664.258975:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84b46 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.258980:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84b46 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785787664.258998:0:5821:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ff432c71 reply state 000000001c68dc67 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84b4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787664.259005:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785787664.259243:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+32:10526:x1872533744829056:12345-192.168.203.53@tcp:36:rm.0 Request processed in 2666us (2847us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1785787664.259252:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 95 00010000:00010000:3.0:1785787664.263593:0:3320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84b4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787664.263617:0:3320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84b4d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787664.263625:0:3320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84b4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787664.263632:0:3320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677d800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787664.263637:0:3320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84b4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787664.263644:0:3320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84b4d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787664.263678:0:3320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9190481f9b00) 00010000:00010000:3.0:1785787664.263682:0:3320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787664.263687:0:3320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84b4d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787664.263694:0:3320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84b4d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787664.314981:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787664.315114:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744829312 00000100:00100000:2.0:1785787664.315124:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744829312 00000100:00100000:2.0:1785787664.315182:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 96 00000100:00100000:2.0:1785787664.315192:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+31:10532:x1872533744829312:12345-192.168.203.53@tcp:101:bash.0 00010000:00010000:2.0:1785787664.315215:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787664.315237:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84b62 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd443 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.315357:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84b69 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.315371:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84b69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.315381:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84b69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.315396:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84b70 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.315403:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84b70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.315425:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84b70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785787664.316069:0:5822:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1785787664.316217:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c400/0xe2c2ff68a6e84b77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.316226:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c400/0xe2c2ff68a6e84b77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.316234:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c400/0xe2c2ff68a6e84b77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.316265:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84b69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.316272:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84b69 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.316278:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84b69 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.316284:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677d200 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787664.316289:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84b69 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.316295:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84b69 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.316306:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9190481f9e00) 00010000:00010000:2.0:1785787664.316308:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787664.316319:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84b69 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.316326:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84b69 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785787664.316340:0:5822:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c53e832c reply state 00000000e4754590 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84b70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787664.316348:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785787664.316373:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84b62 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd443 expref: 34 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.316386:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c400/0xe2c2ff68a6e84b77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd443 expref: 33 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.316393:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9190481f9700) 00010000:00010000:2.0:1785787664.316396:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785787664.316398:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677c400, rc 0) 00000100:00100000:2.0:1785787664.316547:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+34:10532:x1872533744829312:12345-192.168.203.53@tcp:101:bash.0 Request processed in 1356us (1572us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1785787664.316555:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 96 00010000:00010000:0.0:1785787664.320405:0:3319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84b70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.320421:0:3319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84b70 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.320429:0:3319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84b70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.320452:0:3319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677da00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1785787664.320456:0:3319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84b70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.320463:0:3319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84b70 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.320479:0:3319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9190481f9900) 00010000:00010000:0.0:1785787664.320482:0:3319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785787664.320486:0:3319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84b70 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.320493:0:3319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84b70 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787664.326575:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787664.327331:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744829440 00000100:00100000:1.0:1785787664.327340:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744829440 00000100:00100000:1.0:1785787664.327408:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 34 00000100:00100000:1.0:1785787664.327417:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:79280304-55c6-4698-bfc3-29d14648ba45+5:2391:x1872533744829440:12345-192.168.203.53@tcp:101:bash.0 00010000:00010000:1.0:1785787664.327432:0:6619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787664.327449:0:6619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aef30c8a/0xe2c2ff68a6e84b85 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd44a expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1785787664.327472:0:6619:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785787664.327490:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=451s v=(0 0) 00010000:00010000:1.0:1785787664.327494:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785787664.327503:0:6619:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aef30c8a/0xe2c2ff68a6e84b85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd44a expref: 6 pid: 6619 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.327519:0:6619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aef30c8a/0xe2c2ff68a6e84b85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd44a expref: 6 pid: 6619 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.327531:0:6619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919043c0e400, rc 0) 00000100:00100000:1.0:1785787664.327583:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:79280304-55c6-4698-bfc3-29d14648ba45+6:2391:x1872533744829440:12345-192.168.203.53@tcp:101:bash.0 Request processed in 169us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787664.327609:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 34 00000100:00080000:3.0:1785787664.335512:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785787664.342729:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787664.343675:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744829568 00000100:00100000:0.0:1785787664.343685:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744829568 00000100:00100000:0.0:1785787664.343734:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 35 00000100:00100000:0.0:1785787664.343749:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+6:10532:x1872533744829568:12345-192.168.203.53@tcp:101:bash.0 00010000:00010000:0.0:1785787664.343765:0:6618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787664.343781:0:6618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c1fe897/0xe2c2ff68a6e84b8c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd451 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.343810:0:6618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aef30c8a/0xe2c2ff68a6e84b85 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd44a expref: 7 pid: 6619 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.344043:0:6618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785787664.344056:0:6618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785787664.344062:0:6618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c1fe897/0xe2c2ff68a6e84b8c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd451 expref: 7 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.344098:0:6618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aef30c8a/0xe2c2ff68a6e84b85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd44a expref: 7 pid: 6619 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.344113:0:6618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aef30c8a/0xe2c2ff68a6e84b85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd44a expref: 7 pid: 6619 timeout: 551 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787664.344186:0:6618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bd99c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6618:1872533770019456:192.168.203.53@tcp:104: 00000100:00100000:0.0:1785787664.344571:0:6618:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905064ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1785787664.346988:0:6618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bd99c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6618:1872533770019456:192.168.203.53@tcp:104: 00010000:00010000:0.0:1785787664.347016:0:6618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009c1fe897/0xe2c2ff68a6e84b8c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd451 expref: 7 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.347035:0:6618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919050679600, rc 0) 00000100:00100000:0.0:1785787664.347082:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+7:10532:x1872533744829568:12345-192.168.203.53@tcp:101:bash.0 Request processed in 3340us (4362us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787664.347091:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 35 00000100:00100000:3.0:1785787664.348587:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787664.348695:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744829696 00000100:00100000:0.0:1785787664.348703:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744829696 00010000:00010000:0.0:1785787664.348732:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aef30c8a/0xe2c2ff68a6e84b85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd44a expref: 7 pid: 6619 timeout: 551 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787664.348769:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 49 00000100:00100000:0.0:1785787664.348790:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051467850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79280304-55c6-4698-bfc3-29d14648ba45+7:2390:x1872533744829696:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785787664.348803:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785787664.348824:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aef30c8a/0xe2c2ff68a6e84b85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd44a expref: 7 pid: 6619 timeout: 551 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.348867:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aef30c8a/0xe2c2ff68a6e84b85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd44a expref: 7 pid: 6619 timeout: 551 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.348888:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aef30c8a/0xe2c2ff68a6e84b85 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd44a expref: 7 pid: 6619 timeout: 551 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.348903:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785787664.348907:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785787664.348915:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009c1fe897/0xe2c2ff68a6e84b8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd451 expref: 6 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.348925:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c1fe897/0xe2c2ff68a6e84b8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd451 expref: 6 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.348956:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009c1fe897/0xe2c2ff68a6e84b8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd451 expref: 6 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787664.348969:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bd99c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5806:1872533770019584:192.168.203.53@tcp:105: 00000100:00100000:0.0:1785787664.349031:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905064ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1785787664.352051:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bd99c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5806:1872533770019584:192.168.203.53@tcp:105: 00010000:00010000:0.0:1785787664.352083:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785787664.352122:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051467850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79280304-55c6-4698-bfc3-29d14648ba45+6:2390:x1872533744829696:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 3333us (3536us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787664.352132:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 49 00000100:00100000:2.0:1785787664.352994:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787664.355544:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744829952 00000100:00100000:0.0:1785787664.355555:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744829952 00000100:00100000:0.0:1785787664.355661:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 25 00000100:00100000:0.0:1785787664.355672:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905c5f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+33:10532:x1872533744829952:12345-192.168.203.53@tcp:35:bash.0 00000100:00100000:0.0:1785787664.356020:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905c5f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+34:10532:x1872533744829952:12345-192.168.203.53@tcp:35:bash.0 Request processed in 350us (3026us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1785787664.356028:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 25 00000100:00100000:3.0:1785787664.565661:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787664.568773:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744830080 00000100:00100000:0.0:1785787664.568788:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744830080 00000100:00100000:0.0:1785787664.568873:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 97 00000100:00100000:0.0:1785787664.568883:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905267e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+34:10548:x1872533744830080:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:0.0:1785787664.568906:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787664.568926:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919050678a00/0xe2c2ff68a6e84b93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd458 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.568988:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919050678800/0xe2c2ff68a6e84b9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.569003:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919050678800/0xe2c2ff68a6e84b9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.569014:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919050678800/0xe2c2ff68a6e84b9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785787664.569087:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1785787664.569092:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1785787664.569115:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919050678800/0xe2c2ff68a6e84b9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.569140:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919050678a00/0xe2c2ff68a6e84b93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd458 expref: 36 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.569158:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919050678800/0xe2c2ff68a6e84b9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd458 expref: 35 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.569167:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9190481f9e00) 00010000:00010000:0.0:1785787664.569170:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1785787664.569173:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919050678800, rc 0) 00000100:00100000:0.0:1785787664.569238:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905267e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+35:10548:x1872533744830080:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 356us (3587us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787664.569244:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 97 00000100:00100000:2.0:1785787664.572456:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787664.572568:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744830336 00000100:00100000:1.0:1785787664.572635:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744830336 00000100:00100000:1.0:1785787664.572687:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 98 00000100:00100000:1.0:1785787664.572698:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905c5f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+35:10548:x1872533744830336:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:1.0:1785787664.572715:0:9295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787664.572732:0:9295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84ba1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd45f expref: -99 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.572822:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e84ba8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.572973:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e84ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.572985:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e84ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785787664.572996:0:9295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1785787664.573101:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84ba1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd45f expref: 38 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.573117:0:9295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e84ba8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd45f expref: 37 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.573126:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9190481f9700) 00010000:00010000:1.0:1785787664.573129:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785787664.573132:0:9295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919043c0f400, rc 0) 00000100:00100000:1.0:1785787664.573231:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905c5f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+37:10548:x1872533744830336:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 535us (779us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1785787664.573238:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 98 00000100:00100000:3.0:1785787664.580299:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787664.580382:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787664.580489:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744830720 00000100:00100000:1.0:1785787664.580498:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744830720 00000100:00100000:1.0:1785787664.580556:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 99 00000100:00100000:1.0:1785787664.580566:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+37:10548:x1872533744830720:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:1.0:1785787664.580597:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787664.580626:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84bb6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd466 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.580721:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84bbd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.580735:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84bbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.580746:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84bbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785787664.580756:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1785787664.580891:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84bb6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd466 expref: 40 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.580910:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84bbd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd466 expref: 39 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.580918:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9190481f9700) 00010000:00010000:1.0:1785787664.580921:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1785787664.580936:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919043c0e400, rc 0) 00000100:00100000:1.0:1785787664.580998:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+39:10548:x1872533744830720:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 433us (614us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1785787664.581004:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 99 00000100:00100000:0.0:1785787664.583012:0:11051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744830464 00000100:00100000:0.0:1785787664.583023:0:11051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744830464 00000100:00100000:0.0:1785787664.583088:0:11051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 6 00000100:00100000:0.0:1785787664.583098:0:11051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79280304-55c6-4698-bfc3-29d14648ba45+39:2389:x1872533744830464:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785787664.583111:0:11051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785787664.583132:0:11051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e84ba8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd45f expref: 39 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.583148:0:11051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9190481f9700) 00010000:00010000:0.0:1785787664.583163:0:11051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785787664.583214:0:11051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79280304-55c6-4698-bfc3-29d14648ba45+38:2389:x1872533744830464:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 118us (2923us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787664.583222:0:11051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 6 00000100:00100000:2.0:1785787664.585711:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787664.585772:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744830848 00000100:00100000:0.0:1785787664.585781:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744830848 00000100:00100000:0.0:1785787664.585844:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 36 00000100:00100000:0.0:1785787664.585853:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905c5f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:79280304-55c6-4698-bfc3-29d14648ba45+6:2391:x1872533744830848:12345-192.168.203.53@tcp:1:lfs.0 00010000:00010000:0.0:1785787664.585896:0:6619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cd31124/0xe2c2ff68a6e84bcb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.585916:0:6619:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009c1fe897/0xe2c2ff68a6e84b8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd451 expref: 6 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.585925:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785787664.585929:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1785787664.585933:0:6619:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cd31124/0xe2c2ff68a6e84bcb lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.585966:0:6619:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009c1fe897/0xe2c2ff68a6e84b8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd451 expref: 6 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.585980:0:6619:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009c1fe897/0xe2c2ff68a6e84b8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd451 expref: 6 pid: 6618 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787664.585994:0:6619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bd9bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6619:1872533770019712:192.168.203.53@tcp:104: 00000100:00100000:0.0:1785787664.586080:0:6619:0:(client.c:2702:ptlrpc_set_wait()) set ffff91906ef690c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785787664.590865:0:6619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bd9bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6619:1872533770019712:192.168.203.53@tcp:104: 00010000:00010000:0.0:1785787664.590895:0:6619:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008cd31124/0xe2c2ff68a6e84bcb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787664.592777:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787664.593147:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744830976 00000100:00100000:3.0:1785787664.593157:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744830976 00002000:00100000:3.0:1785787664.593199:0:6623:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff91905c5f9f80 x1872533744830976/t0(0) o4->79280304-55c6-4698-bfc3-29d14648ba45@192.168.203.53@tcp:520/0 lens 504/0 e 0 to 0 dl 1785787675 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785787664.593210:0:6623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91905c5f9f80 with x1872533744830976 ext(0->8) 00010000:00010000:3.0:1785787664.593218:0:6623:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009c1fe897/0xe2c2ff68a6e84b8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd451 expref: 7 pid: 6618 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787664.593235:0:6623:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009c1fe897/0xe2c2ff68a6e84b8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd451 expref: 7 pid: 6618 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785787664.593243:0:6623:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff91905c5f9f80 00000100:00100000:3.0:1785787664.593276:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 1 00000100:00100000:3.0:1785787664.593285:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905c5f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:79280304-55c6-4698-bfc3-29d14648ba45+7:2390:x1872533744830976:12345-192.168.203.53@tcp:4:lfs.0 00000100:00100000:3.0:1785787664.593991:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905c5f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:79280304-55c6-4698-bfc3-29d14648ba45+9:2390:x1872533744830976:12345-192.168.203.53@tcp:4:lfs.0 Request processed in 705us (1217us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1785787664.593999:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 1 00002000:00100000:3.0:1785787664.594007:0:6623:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff91905c5f9f80 x1872533744830976/t4294967302(0) o4->79280304-55c6-4698-bfc3-29d14648ba45@192.168.203.53@tcp:520/0 lens 504/448 e 0 to 0 dl 1785787675 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785787664.594015:0:6623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91905c5f9f80 with x1872533744830976 ext(0->8) 00010000:00010000:3.0:1785787664.594021:0:6623:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009c1fe897/0xe2c2ff68a6e84b8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd451 expref: 9 pid: 6618 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787664.594033:0:6623:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009c1fe897/0xe2c2ff68a6e84b8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd451 expref: 9 pid: 6618 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785787664.594040:0:6623:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff91905c5f9f80 00000100:00100000:2.0:1785787664.602514:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787664.603428:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744831104 00000100:00100000:3.0:1785787664.603438:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744831104 00010000:00010000:3.0:1785787664.603488:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009c1fe897/0xe2c2ff68a6e84b8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd451 expref: 9 pid: 6618 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787664.603592:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 50 00000100:00100000:3.0:1785787664.603611:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905c5fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79280304-55c6-4698-bfc3-29d14648ba45+9:2391:x1872533744831104:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785787664.603626:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1785787664.603645:0:5807:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1785787664.603648:0:5807:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1785787664 00002000:00010000:3.0:1785787664.603651:0:5807:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1785787664 00002000:00010000:3.0:1785787664.603653:0:5807:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1785787664 00010000:00010000:3.0:1785787664.603672:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009c1fe897/0xe2c2ff68a6e84b8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd451 expref: 9 pid: 6618 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787664.603686:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009c1fe897/0xe2c2ff68a6e84b8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd451 expref: 9 pid: 6618 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787664.603712:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c1fe897/0xe2c2ff68a6e84b8c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd451 expref: 9 pid: 6618 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787664.603729:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1785787664.603733:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1785787664.603738:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008cd31124/0xe2c2ff68a6e84bcb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787664.603748:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cd31124/0xe2c2ff68a6e84bcb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787664.603778:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787664.603866:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905c5fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79280304-55c6-4698-bfc3-29d14648ba45+8:2391:x1872533744831104:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 265us (1360us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787664.603874:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 50 00010000:00010000:1.0:1785787664.603956:0:6619:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008cd31124/0xe2c2ff68a6e84bcb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.603966:0:6619:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cd31124/0xe2c2ff68a6e84bcb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.603990:0:6619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cd31124/0xe2c2ff68a6e84bcb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.603998:0:6619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cd31124/0xe2c2ff68a6e84bcb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.604006:0:6619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cd31124/0xe2c2ff68a6e84bcb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.604013:0:6619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919050678a00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785787664.604017:0:6619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cd31124/0xe2c2ff68a6e84bcb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.604025:0:6619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cd31124/0xe2c2ff68a6e84bcb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.604037:0:6619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cd31124/0xe2c2ff68a6e84bcb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.604051:0:6619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cd31124/0xe2c2ff68a6e84bcb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787664.604095:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905c5f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:79280304-55c6-4698-bfc3-29d14648ba45+7:2391:x1872533744830848:12345-192.168.203.53@tcp:1:lfs.0 Request processed in 18243us (18390us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787664.604102:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 36 00000100:00100000:2.0:1785787664.616125:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787664.616210:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744831360 00000100:00100000:1.0:1785787664.616221:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744831360 00000100:00100000:1.0:1785787664.616282:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 26 00000100:00100000:1.0:1785787664.616292:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190451bc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+38:10548:x1872533744831360:12345-192.168.203.53@tcp:35:lfs.0 00000004:00010000:1.0:1785787664.616351:0:5823:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84bbd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd466 expref: 38 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785787664.616584:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1785787664.616641:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1785787664.616975:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1785787664.617029:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84bd2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.617044:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c400/0xe2c2ff68a6e84b77 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd443 expref: 42 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.617053:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84bd2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.617083:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c400/0xe2c2ff68a6e84b77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd443 expref: 42 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.617114:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c400/0xe2c2ff68a6e84b77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd443 expref: 42 pid: 5822 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787664.617128:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076ecd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5823:1872533770019840:192.168.203.53@tcp:104: 00000100:00100000:1.0:1785787664.617198:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905159dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1785787664.620747:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787664.620866:0:11051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744831488 00000100:00100000:0.0:1785787664.620874:0:11051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744831488 00010000:00010000:0.0:1785787664.620906:0:11051:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c400/0xe2c2ff68a6e84b77 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd443 expref: 43 pid: 5822 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787664.620942:0:11051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 51 00000100:00100000:0.0:1785787664.620950:0:11051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905c5f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79280304-55c6-4698-bfc3-29d14648ba45+43:2391:x1872533744831488:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785787664.620963:0:11051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785787664.620969:0:11051:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c400/0xe2c2ff68a6e84b77 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd443 expref: 43 pid: 5822 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.620981:0:11051:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c400/0xe2c2ff68a6e84b77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd443 expref: 43 pid: 5822 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.621000:0:11051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9190481f9700) 00010000:00010000:0.0:1785787664.621005:0:11051:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84bd2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.621013:0:11051:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84bd2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.621020:0:11051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84bd2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787664.621035:0:11051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785787664.621083:0:11051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905c5f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79280304-55c6-4698-bfc3-29d14648ba45+43:2391:x1872533744831488:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 134us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787664.621091:0:11051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 51 00010000:00010000:1.0:1785787664.622713:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c400/0xe2c2ff68a6e84b77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd443 expref: 42 pid: 5822 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787664.622734:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076ecd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5823:1872533770019840:192.168.203.53@tcp:104: 00010000:00010000:1.0:1785787664.622753:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84bd2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.622761:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84bd2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.622767:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84bd2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785787664.622915:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1785787664.623095:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1785787664.623187:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076ecd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5823:1872533770019968:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1785787664.623235:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787664.623270:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905159de40 going to sleep for 11 seconds 00000100:00100000:3.0:1785787664.623422:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770019968 00000100:00100000:3.0:1785787664.623429:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770019968 00000100:00100000:3.0:1785787664.623567:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1785787664.623669:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785787664.623674:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ecd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5823:x1872533770019968:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1785787664.623750:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ecd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5823:x1872533770019968:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 176us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787664.623768:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1785787664.623885:0:5823:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1785787664.623892:0:5823:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1785787664.623909:0:5823:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91907fd92680, transno 4294967301 00000100:00100000:1.0:1785787664.627761:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076ecd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5823:1872533770019968:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1785787664.628268:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1785787664.628346:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076ecd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5823:1872533770020096:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1785787664.628404:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787664.628432:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905159dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1785787664.628543:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770020096 00000100:00100000:0.0:1785787664.628551:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770020096 00000100:00100000:0.0:1785787664.628616:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1785787664.628626:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5823:x1872533770020096:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1785787664.628787:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5823:x1872533770020096:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 162us (381us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1785787664.628795:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1785787664.628943:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076ecd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5823:1872533770020096:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1785787664.628987:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1785787664.629021:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84bd2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.629031:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84bd2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.629039:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84bd2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.629045:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0ec00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787664.629049:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84bd2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.629056:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84bd2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.629072:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9190481f9700) 00010000:00010000:1.0:1785787664.629075:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1785787664.629079:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84bd2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.629086:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84bd2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785787664.629252:0:5823:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1785787664.629345:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1785787664.629356:0:5823:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 451873527315ns, next at 452873524844ns, rc = 0 00000001:00080000:1.0:1785787664.629362:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1785787664.629391:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9190481f9700) 00010000:00010000:1.0:1785787664.629394:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1785787664.629401:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84bbd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd466 expref: 46 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787664.629502:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190451bc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+45:10548:x1872533744831360:12345-192.168.203.53@tcp:35:lfs.0 Request processed in 13210us (13386us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1785787664.629510:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 26 00000020:00080000:1.0:1785787664.629513:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1785787664.631939:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787664.637816:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744831616 00000100:00100000:3.0:1785787664.637929:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744831616 00000100:00100000:3.0:1785787664.638030:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 100 00000100:00100000:3.0:1785787664.638043:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905c5f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+45:10548:x1872533744831616:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:3.0:1785787664.638067:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787664.638089:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84bd9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd46d expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787664.638146:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84bd9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd46d expref: 46 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787664.638162:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84bd9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd46d expref: 46 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787664.638182:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919055acd300) 00010000:00010000:3.0:1785787664.638186:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785787664.638190:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f903000, rc 0) 00000100:00100000:3.0:1785787664.638256:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905c5f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+46:10548:x1872533744831616:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 216us (6322us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787664.638263:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 100 00000100:00100000:3.0:1785787664.654094:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787664.654188:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744831872 00000100:00100000:0.0:1785787664.654198:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744831872 00000100:00100000:0.0:1785787664.654257:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 27 00000100:00100000:0.0:1785787664.654268:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+46:10548:x1872533744831872:12345-192.168.203.53@tcp:35:lfs.0 00000100:00100000:0.0:1785787664.654549:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+47:10548:x1872533744831872:12345-192.168.203.53@tcp:35:lfs.0 Request processed in 282us (461us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1785787664.654557:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 27 00000100:00100000:2.0:1785787664.785368:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787664.786708:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744832000 00000100:00100000:1.0:1785787664.786718:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744832000 00000100:00100000:1.0:1785787664.786814:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 101 00000100:00100000:1.0:1785787664.786825:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905069e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+47:10558:x1872533744832000:12345-192.168.203.53@tcp:34:lfs.0 00010000:00010000:1.0:1785787664.786908:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84be0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.786924:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84be0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.786937:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84be0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.786952:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84be7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.786977:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84be7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.786984:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84be7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.787077:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84bee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.787084:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84bee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.787090:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84bee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785787664.787127:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84bee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.787137:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84be0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.787142:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84be0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.787148:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84be0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.787153:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0e400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787664.787156:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84be0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.787162:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84be0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.787178:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9190481f9e00) 00010000:00010000:1.0:1785787664.787181:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785787664.787185:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84be0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.787190:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84be0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.787202:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84be7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.787208:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84be7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.787213:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84be7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.787216:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0ec00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787664.787218:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84be7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.787223:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84be7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.787228:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91905685f300) 00010000:00010000:1.0:1785787664.787230:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785787664.787232:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84be7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.787236:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84be7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.787259:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84bee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.787264:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84bee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.787269:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84bee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.787272:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0fe00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787664.787275:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84bee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.787280:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84bee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.787286:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919055acd300) 00010000:00010000:1.0:1785787664.787289:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785787664.787291:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84bee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.787295:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84bee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787664.787366:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905069e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+47:10558:x1872533744832000:12345-192.168.203.53@tcp:34:lfs.0 Request processed in 543us (2007us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787664.787373:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 101 00000100:00100000:2.0:1785787664.842792:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787664.842925:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744832256 00000100:00100000:1.0:1785787664.842934:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744832256 00000100:00100000:1.0:1785787664.842985:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 102 00000100:00100000:1.0:1785787664.843006:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905069ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+47:10561:x1872533744832256:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:1.0:1785787664.843026:0:9295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787664.843045:0:9295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84bf5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd474 expref: -99 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.843110:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84bfc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.843124:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84bfc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.843135:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84bfc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.843149:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84c03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.843156:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84c03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.843163:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84c03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.843282:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84c0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.843291:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84c0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.843298:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84c0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785787664.843319:0:9295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1785787664.843408:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84bfc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.843415:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84bfc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.843421:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84bfc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.843425:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0ec00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787664.843429:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84bfc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.843435:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84bfc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.843444:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9190481f9e00) 00010000:00010000:1.0:1785787664.843446:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785787664.843450:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84bfc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.843454:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84bfc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.843463:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84c03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.843468:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84c03 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.843481:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84c03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.843486:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0e400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787664.843488:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84c03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.843492:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84c03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.843498:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91905685f300) 00010000:00010000:1.0:1785787664.843500:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785787664.843502:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84c03 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.843506:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84c03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.843549:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84bf5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd474 expref: 50 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.843560:0:9295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84c0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd474 expref: 49 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.843566:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919055acd300) 00010000:00010000:1.0:1785787664.843568:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785787664.843570:0:9295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919043c0ea00, rc 0) 00000100:00100000:1.0:1785787664.843715:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905069ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+49:10561:x1872533744832256:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 710us (933us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1785787664.843730:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 102 00000100:00100000:3.0:1785787664.856769:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787664.856908:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744832384 00000100:00100000:2.0:1785787664.856917:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744832384 00000100:00100000:2.0:1785787664.856971:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 103 00000100:00100000:2.0:1785787664.856979:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+49:10561:x1872533744832384:12345-192.168.203.53@tcp:54:lfs.0 00010000:00010000:2.0:1785787664.857039:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84c18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.857055:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84c18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.857067:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84c18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.857092:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84c18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.857099:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84c18 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.857106:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84c18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.857111:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677dc00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787664.857115:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84c18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.857122:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84c18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.857145:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919055acd300) 00010000:00010000:2.0:1785787664.857148:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785787664.857153:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84c18 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.857159:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84c18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787664.857229:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+49:10561:x1872533744832384:12345-192.168.203.53@tcp:54:lfs.0 Request processed in 250us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787664.857237:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 103 00000100:00100000:2.0:1785787664.860995:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787664.861077:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744832640 00000100:00100000:0.0:1785787664.861086:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744832640 00000100:00100000:0.0:1785787664.861139:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 28 00000100:00100000:0.0:1785787664.861148:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905069fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+49:10561:x1872533744832640:12345-192.168.203.53@tcp:35:lfs.0 00000100:00100000:0.0:1785787664.861354:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905069fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+50:10561:x1872533744832640:12345-192.168.203.53@tcp:35:lfs.0 Request processed in 207us (364us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1785787664.861361:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 28 00010000:00010000:3.0:1785787664.883783:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787664.976290:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787664.976435:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744832896 00000100:00100000:1.0:1785787664.976445:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744832896 00000100:00100000:1.0:1785787664.976499:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 104 00000100:00100000:1.0:1785787664.976508:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+50:10571:x1872533744832896:12345-192.168.203.53@tcp:101:bash.0 00010000:00010000:1.0:1785787664.976539:0:9295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787664.976542:0:9295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1785787664.976568:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919050678800/0xe2c2ff68a6e84b9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd458 expref: 50 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.976586:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9190481f9e00) 00010000:00010000:1.0:1785787664.976590:0:9295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785787664.976609:0:9295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84c1f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd47b expref: -99 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.976695:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84c26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.976707:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84c26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.976715:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84c26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785787664.976724:0:9295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1785787664.976910:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84c1f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd47b expref: 52 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.976939:0:9295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84c26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd47b expref: 51 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.976945:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919055acd300) 00010000:00010000:1.0:1785787664.976948:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785787664.976950:0:9295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919043c0e400, rc 0) 00000100:00100000:1.0:1785787664.976998:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+51:10571:x1872533744832896:12345-192.168.203.53@tcp:101:bash.0 Request processed in 491us (716us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1785787664.977003:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 104 00000100:00100000:3.0:1785787664.985740:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787664.985822:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787664.988411:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744833280 00000100:00100000:2.0:1785787664.988425:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744833280 00000100:00100000:2.0:1785787664.988489:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 105 00000100:00100000:2.0:1785787664.988498:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+51:10571:x1872533744833280:12345-192.168.203.53@tcp:36:bash.0 00010000:00010000:2.0:1785787664.988563:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785787664.988588:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84c0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd474 expref: 51 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.988613:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919055acd300) 00010000:00010000:2.0:1785787664.988618:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785787664.988905:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84c34 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.988918:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84c26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd47b expref: 51 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.988939:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84c34 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.988967:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84c26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd47b expref: 51 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787664.988978:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84c26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd47b expref: 51 pid: 9295 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787664.988989:0:5821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905069f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5821:1872533770020224:192.168.203.53@tcp:104: 00000100:00100000:2.0:1785787664.989095:0:5821:0:(client.c:2702:ptlrpc_set_wait()) set ffff91904830bb40 going to sleep for 11 seconds 00010000:00010000:3.0:1785787664.991969:0:5821:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.53@tcp) returned -22 from blocking AST (req@00000000e447a6fe x1872533770020224) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84c26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd47b expref: 51 pid: 9295 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787664.991989:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84c26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd47b expref: 51 pid: 9295 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787664.992008:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84c26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd47b expref: 51 pid: 9295 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787664.992020:0:5821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905069f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5821:1872533770020224:192.168.203.53@tcp:104: 00010000:00010000:3.0:1785787664.992038:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919055acd300) 00010000:00010000:3.0:1785787664.992042:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84c34 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787664.992050:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84c34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787664.992057:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84c34 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787664.992074:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84c34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787664.992081:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84c34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787664.992086:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84c34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785787664.992199:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1785787664.992274:0:5821:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009e0f28c7 reply state 00000000cf6859c5 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84c34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787664.992283:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785787664.992383:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+52:10571:x1872533744833280:12345-192.168.203.53@tcp:36:bash.0 Request processed in 3884us (6559us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1785787664.992391:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 105 00000020:00080000:3.0:1785787664.992396:0:5821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1785787664.992633:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744833024 00000100:00100000:0.0:1785787664.992640:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744833024 00000100:00100000:0.0:1785787664.992696:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 7 00000100:00100000:0.0:1785787664.992705:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79280304-55c6-4698-bfc3-29d14648ba45+52:2388:x1872533744833024:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785787664.992716:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785787664.992719:0:5806:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie e2c2ff68a6e84c26) 00010000:00010000:0.0:1785787664.992721:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785787664.992745:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79280304-55c6-4698-bfc3-29d14648ba45+52:2388:x1872533744833024:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 43us (7014us total) trans 0 rc 116/116 00000100:00100000:0.0:1785787664.992751:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 7 00010000:00010000:3.0:1785787664.996305:0:3320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84c34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787664.996322:0:3320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84c34 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787664.996331:0:3320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84c34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787664.996337:0:3320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677ca00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787664.996342:0:3320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84c34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787664.996349:0:3320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84c34 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787664.996363:0:3320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919055acd300) 00010000:00010000:3.0:1785787664.996366:0:3320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787664.996370:0:3320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84c34 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787664.996376:0:3320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84c34 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787664.997245:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787664.997320:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744833408 00000100:00100000:1.0:1785787664.997330:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744833408 00000100:00100000:1.0:1785787664.997384:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 106 00000100:00100000:1.0:1785787664.997393:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905069f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+51:10571:x1872533744833408:12345-192.168.203.53@tcp:101:bash.0 00010000:00010000:1.0:1785787664.997411:0:9295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787664.997427:0:9295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84c3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd482 expref: -99 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.997523:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84c42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.997535:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84c42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.997544:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84c42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785787664.997572:0:9295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1785787664.997582:0:9295:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1785787664.997612:0:9295:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84c42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.997636:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84c3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd482 expref: 53 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.997650:0:9295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84c42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd482 expref: 52 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787664.997656:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919055acd300) 00010000:00010000:1.0:1785787664.997659:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785787664.997661:0:9295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919043c0fa00, rc 0) 00000100:00100000:1.0:1785787664.997717:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905069f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+52:10571:x1872533744833408:12345-192.168.203.53@tcp:101:bash.0 Request processed in 325us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787664.997723:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 106 00000100:00100000:2.0:1785787664.999630:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787664.999694:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744833664 00000100:00100000:0.0:1785787664.999701:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744833664 00000100:00100000:0.0:1785787664.999751:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 29 00000100:00100000:0.0:1785787664.999759:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+52:10571:x1872533744833664:12345-192.168.203.53@tcp:35:bash.0 00000100:00100000:0.0:1785787664.999980:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+53:10571:x1872533744833664:12345-192.168.203.53@tcp:35:bash.0 Request processed in 221us (354us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1785787664.999987:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 29 00000100:00100000:2.0:1785787665.027449:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787665.027507:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787665.027544:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787665.027573:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787665.027639:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744833920 00000100:00100000:3.0:1785787665.027659:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744833920 00000100:00100000:3.0:1785787665.027705:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744834048 00000100:00100000:3.0:1785787665.027707:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744834048 00000100:00100000:3.0:1785787665.027732:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 89 00000100:00100000:3.0:1785787665.027740:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:79280304-55c6-4698-bfc3-29d14648ba45+7:2390:x1872533744833920:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1785787665.027799:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:79280304-55c6-4698-bfc3-29d14648ba45+7:2390:x1872533744833920:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 60us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787665.027805:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 89 00000100:00100000:3.0:1785787665.027820:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 90 00000100:00100000:3.0:1785787665.027825:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:79280304-55c6-4698-bfc3-29d14648ba45+8:2390:x1872533744834048:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1785787665.027871:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:79280304-55c6-4698-bfc3-29d14648ba45+8:2390:x1872533744834048:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 45us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787665.027877:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 90 00000100:00100000:0.0:1785787665.027946:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744833792 00000100:00100000:0.0:1785787665.027950:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744833792 00000100:00100000:0.0:1785787665.027977:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 301 00000100:00100000:0.0:1785787665.027983:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051504450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2390:x1872533744833792:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1785787665.028007:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051504450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2390:x1872533744833792:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 25us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787665.028012:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 301 00000100:00080000:2.0:1785787665.028295:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785787665.028451:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744834176 00000100:00100000:1.0:1785787665.028455:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744834176 00000100:00100000:1.0:1785787665.028500:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 163 00000100:00100000:1.0:1785787665.028506:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4ec65b7-e63e-42dc-becf-cba362002085+5:2390:x1872533744834176:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1785787665.028554:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4ec65b7-e63e-42dc-becf-cba362002085+5:2390:x1872533744834176:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 47us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787665.028560:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 163 00000100:00080000:2.0:1785787665.028989:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785787665.109520:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787665.109609:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744834304 00000100:00100000:1.0:1785787665.109618:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744834304 00000100:00100000:1.0:1785787665.109714:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 107 00000100:00100000:1.0:1785787665.109723:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+53:10577:x1872533744834304:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:1.0:1785787665.109744:0:9295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787665.109774:0:9295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84c49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd489 expref: -99 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.109862:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84c50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.109876:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84c50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.109888:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84c50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785787665.109960:0:9295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1785787665.109964:0:9295:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1785787665.109982:0:9295:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84c50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.110005:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84c49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd489 expref: 55 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.110020:0:9295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84c50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd489 expref: 54 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.110028:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9190481f9e00) 00010000:00010000:1.0:1785787665.110031:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785787665.110034:0:9295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919043c0e400, rc 0) 00000100:00100000:1.0:1785787665.110091:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+54:10577:x1872533744834304:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 369us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787665.110097:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 107 00000100:00080000:2.0:1785787665.110179:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785787665.115556:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787665.115661:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744834432 00000100:00100000:1.0:1785787665.115678:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744834432 00000100:00100000:1.0:1785787665.115726:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 108 00000100:00100000:1.0:1785787665.115734:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+54:10577:x1872533744834432:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:1.0:1785787665.115751:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787665.115770:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84c57 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd490 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.115823:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84c5e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.115853:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84c5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.115864:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84c5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.115879:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84c65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.115887:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84c65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.115893:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84c65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.116004:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e84c6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.116012:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e84c6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.116018:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e84c6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785787665.116053:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1785787665.116057:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1785787665.116086:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e84c6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.116096:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e84c6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.116103:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84c5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.116119:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84c5e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.116125:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84c5e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.116131:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0ea00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787665.116134:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84c5e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.116140:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84c5e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.116149:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9190481f9e00) 00010000:00010000:1.0:1785787665.116152:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785787665.116155:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84c5e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.116160:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84c5e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.116184:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84c65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.116190:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84c65 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.116195:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84c65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.116200:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0fe00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787665.116203:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84c65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.116208:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84c65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.116215:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91905685f300) 00010000:00010000:1.0:1785787665.116217:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785787665.116219:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84c65 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.116224:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84c65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.116254:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84c57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd490 expref: 56 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.116268:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e84c6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd490 expref: 55 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.116285:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919055acd300) 00010000:00010000:1.0:1785787665.116287:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785787665.116289:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919043c0f400, rc 0) 00000100:00100000:1.0:1785787665.116346:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+55:10577:x1872533744834432:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 612us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787665.116353:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 108 00000100:00100000:0.0:1785787665.118551:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787665.118605:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787665.118675:0:11051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744834560 00000100:00100000:3.0:1785787665.118682:0:11051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744834560 00000100:00100000:3.0:1785787665.118730:0:11051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 8 00000100:00100000:3.0:1785787665.118739:0:11051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79280304-55c6-4698-bfc3-29d14648ba45+55:2391:x1872533744834560:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785787665.118750:0:11051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787665.118766:0:11051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e84c6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd490 expref: 55 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787665.118780:0:11051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919055acd300) 00010000:00010000:3.0:1785787665.118783:0:11051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787665.118820:0:11051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79280304-55c6-4698-bfc3-29d14648ba45+54:2391:x1872533744834560:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 82us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787665.118851:0:11051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 8 00000100:00100000:2.0:1785787665.119941:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744834816 00000100:00100000:2.0:1785787665.119946:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744834816 00000100:00100000:2.0:1785787665.120004:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 109 00000100:00100000:2.0:1785787665.120011:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+54:10577:x1872533744834816:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:2.0:1785787665.120041:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787665.120060:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84c73 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd497 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.120157:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84c7a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.120168:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84c42 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd482 expref: 55 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.120176:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84c7a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.120204:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84c42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd482 expref: 55 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.120215:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84c42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd482 expref: 55 pid: 9295 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787665.120228:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5822:1872533770020352:192.168.203.53@tcp:104: 00000100:00100000:2.0:1785787665.120299:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff91904830b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785787665.122634:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5822:1872533770020352:192.168.203.53@tcp:104: 00010000:00010000:2.0:1785787665.122658:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84c7a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787665.123170:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787665.123399:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744834944 00000100:00100000:3.0:1785787665.123405:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744834944 00010000:00010000:3.0:1785787665.123433:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84c42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd482 expref: 56 pid: 9295 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787665.123475:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 52 00000100:00100000:3.0:1785787665.123482:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79280304-55c6-4698-bfc3-29d14648ba45+56:2390:x1872533744834944:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785787665.123493:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787665.123499:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84c42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd482 expref: 56 pid: 9295 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787665.123509:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84c42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd482 expref: 56 pid: 9295 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787665.123526:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84c42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd482 expref: 56 pid: 9295 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787665.123539:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919055acd300) 00010000:00010000:3.0:1785787665.123543:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84c7a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787665.123551:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84c7a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787665.123557:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84c7a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787665.123581:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787665.123624:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79280304-55c6-4698-bfc3-29d14648ba45+55:2390:x1872533744834944:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 142us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787665.123637:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 52 00010000:00010000:2.0:1785787665.123736:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84c7a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.123743:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84c7a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787665.123766:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1785787665.123937:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84c73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd497 expref: 56 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.123952:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84c7a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd497 expref: 55 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.123958:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919055acd300) 00010000:00010000:2.0:1785787665.123961:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1785787665.123963:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677ca00, rc 0) 00000100:00100000:2.0:1785787665.123989:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+55:10577:x1872533744834816:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 3980us (5384us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1785787665.123995:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 109 00000100:00100000:0.0:1785787665.125789:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787665.125863:0:11051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744835200 00000100:00100000:3.0:1785787665.125870:0:11051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744835200 00000100:00100000:3.0:1785787665.125908:0:11051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 9 00000100:00100000:3.0:1785787665.125915:0:11051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051465050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79280304-55c6-4698-bfc3-29d14648ba45+55:10577:x1872533744835200:12345-192.168.203.53@tcp:103:lfs.0 00010000:00010000:3.0:1785787665.125926:0:11051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787665.125940:0:11051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84bd9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd46d expref: 55 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787665.125952:0:11051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919055acd300) 00010000:00010000:3.0:1785787665.125955:0:11051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787665.125982:0:11051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051465050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79280304-55c6-4698-bfc3-29d14648ba45+54:10577:x1872533744835200:12345-192.168.203.53@tcp:103:lfs.0 Request processed in 67us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787665.125988:0:11051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 9 00000100:00100000:3.0:1785787665.127066:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787665.127169:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744835328 00000100:00100000:1.0:1785787665.127173:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744835328 00000100:00100000:1.0:1785787665.127232:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 110 00000100:00100000:1.0:1785787665.127241:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+54:10577:x1872533744835328:12345-192.168.203.53@tcp:58:lfs.0 00010000:00010000:1.0:1785787665.127331:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84c88 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.127354:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84c88 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.127363:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84c88 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1785787665.127555:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1785787665.127618:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+54:10577:x1872533744835328:12345-192.168.203.53@tcp:58:lfs.0 Request processed in 378us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787665.127625:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 110 00000100:00100000:1.0:1785787665.133579:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787665.133769:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744835456 00000100:00100000:3.0:1785787665.133778:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744835456 00000100:00100000:3.0:1785787665.133866:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 111 00000100:00100000:3.0:1785787665.133876:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+54:10577:x1872533744835456:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:3.0:1785787665.133894:0:9295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787665.133911:0:9295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e84c8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd49e expref: -99 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787665.133957:0:9295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84c88 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787665.133967:0:9295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e84c8f lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd49e expref: 55 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787665.133996:0:9295:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84c88 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787665.134008:0:9295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e84c8f lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd49e expref: 55 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787665.134020:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919055acd300) 00010000:00010000:3.0:1785787665.134023:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785787665.134026:0:9295:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e84c8f lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd49e expref: 55 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787665.134032:0:9295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f903600, rc 0) 00000100:00100000:3.0:1785787665.134074:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+55:10577:x1872533744835456:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 200us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787665.134080:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 111 00000100:00100000:3.0:1785787665.333125:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905c5f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770020864:0@lo:400:kworker.0 00000100:00100000:3.0:1785787665.333203:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787665.333268:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785787665.333275:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905c5fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3336:1872533770020736:0@lo:400:kworker.0 00000100:00100000:3.0:1785787665.333315:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787665.333347:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770020864 00000100:00100000:3.0:1785787665.333354:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770020864 00000100:00100000:3.0:1785787665.333399:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1785787665.333407:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3336:x1872533770020864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787665.333450:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3336:x1872533770020864:12345-0@lo:400:kworker.0 Request processed in 44us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787665.333478:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1785787665.333523:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905c5f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770020864:0@lo:400:kworker.0 00000100:00100000:0.0:1785787665.333675:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bd78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533770020608:0@lo:400:kworker.0 00000100:00100000:0.0:1785787665.333724:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787665.333746:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bb35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770021120:0@lo:400:kworker.0 00000100:00100000:0.0:1785787665.333766:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787665.333790:0:3334:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1785787665.333796:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bd7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533770020480:0@lo:400:kworker.0 00000100:00100000:0.0:1785787665.333823:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787665.333868:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bd99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3334:1872533770020992:0@lo:400:kworker.0 00000100:00100000:0.0:1785787665.333890:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787665.333913:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770020480 00000100:00100000:0.0:1785787665.333916:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770020480 00000100:00100000:0.0:1785787665.333940:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1785787665.333945:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051506050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+19:3334:x1872533770020480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787665.333973:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051506050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+19:3334:x1872533770020480:12345-0@lo:400:kworker.0 Request processed in 28us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787665.333979:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1785787665.334015:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770021120 00000100:00100000:0.0:1785787665.334018:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770021120 00000100:00100000:0.0:1785787665.334050:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1785787665.334056:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3334:x1872533770021120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787665.334083:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3334:x1872533770021120:12345-0@lo:400:kworker.0 Request processed in 28us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787665.334088:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:0.0:1785787665.334102:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785787665.334133:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bd7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533770020480:0@lo:400:kworker.0 00000100:00100000:0.0:1785787665.334151:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bb35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770021120:0@lo:400:kworker.0 00000100:00100000:3.0:1785787665.334310:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770020736 00000100:00100000:3.0:1785787665.334324:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770020736 00000100:00100000:3.0:1785787665.334355:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770020608 00000100:00100000:3.0:1785787665.334358:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770020608 00000100:00100000:3.0:1785787665.334369:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770020992 00000100:00100000:3.0:1785787665.334371:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770020992 00000100:00100000:3.0:1785787665.334385:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1785787665.334391:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3336:x1872533770020736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787665.334423:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3336:x1872533770020736:12345-0@lo:400:kworker.0 Request processed in 33us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787665.334428:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1785787665.334448:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905c5fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3336:1872533770020736:0@lo:400:kworker.0 00000100:00100000:3.0:1785787665.334472:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1785787665.334478:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533770020608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787665.334504:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533770020608:12345-0@lo:400:kworker.0 Request processed in 27us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787665.334510:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1785787665.334519:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1785787665.334524:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907708aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3334:x1872533770020992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787665.334545:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907708aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3334:x1872533770020992:12345-0@lo:400:kworker.0 Request processed in 21us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787665.334551:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:0.0:1785787665.335974:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785787665.335999:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bd99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3334:1872533770020992:0@lo:400:kworker.0 00000100:00100000:0.0:1785787665.336009:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bd78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533770020608:0@lo:400:kworker.0 00000004:00080000:0.0:1785787665.845644:0:7825:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 453089813420ns, next at 454089811569ns, rc = 0 00000100:00100000:3.0:1785787665.845716:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785787665.845749:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077088380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770021248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785787665.845807:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787665.846002:0:6621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770021248 00000100:00100000:0.0:1785787665.846009:0:6621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770021248 00000100:00100000:0.0:1785787665.846053:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1785787665.846061:0:6621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3336:x1872533770021248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785787665.846088:0:6621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785787665.846272:0:6621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3336:x1872533770021248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 210us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787665.846280:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1785787665.846361:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077088380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770021248:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785787665.918736:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1785787665.919022:0:11564:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1785787665.919028:0:11564:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1785787665.919070:0:11564:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1785787665.919077:0:11564:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1785787665.919223:0:11564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077088380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11564:1872533770021376:192.168.203.53@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1785787665.919322:0:11564:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190456ad600 going to sleep for 11 seconds 00000100:00100000:0.0:1785787665.926892:0:11564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077088380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11564:1872533770021376:192.168.203.53@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1785787665.927019:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787665.927093:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744835584 00000100:00100000:2.0:1785787665.927100:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744835584 00000100:00100000:2.0:1785787665.927160:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 112 00000100:00100000:2.0:1785787665.927170:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+55:10578:x1872533744835584:12345-192.168.203.53@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1785787665.927210:0:5821:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1785787665.927296:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+55:10578:x1872533744835584:12345-192.168.203.53@tcp:53:lhsmtool_posix.0 Request processed in 127us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787665.927303:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 112 00000100:00100000:1.0:1785787665.932267:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787665.932443:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744835712 00000100:00100000:2.0:1785787665.932452:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744835712 00000100:00100000:2.0:1785787665.932506:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 113 00000100:00100000:2.0:1785787665.932515:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+55:10578:x1872533744835712:12345-192.168.203.53@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1785787665.932606:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84c96 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.932726:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84c96 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.932738:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84c96 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.933272:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84c9d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.933282:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84c9d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.933290:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84c9d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.933313:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84ca4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.933321:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.933328:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787665.933751:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1785787665.933758:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785787665.933772:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.933783:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84c96 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.933910:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84c96 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.933917:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84c96 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.933923:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677da00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787665.933926:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84c96 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.933932:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84c96 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.933944:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9190481f9400) 00010000:00010000:2.0:1785787665.933947:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787665.933951:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84c96 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.933957:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84c96 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.933971:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84c9d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.933978:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84c9d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.933983:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84c9d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.933988:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677d800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787665.933997:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84c9d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.934002:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84c9d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.934009:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9190481f9200) 00010000:00010000:2.0:1785787665.934012:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787665.934014:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84c9d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.934019:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84c9d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.934033:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.934039:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84ca4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.934044:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84ca4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.934048:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677dc00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787665.934050:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84ca4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.934055:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84ca4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.934062:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919055acd300) 00010000:00010000:2.0:1785787665.934064:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787665.934073:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84ca4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.934078:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84ca4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787665.938136:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+55:10578:x1872533744835712:12345-192.168.203.53@tcp:34:lhsmtool_posix.0 Request processed in 5265us (5522us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787665.938150:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 113 00000100:00100000:0.0:1785787665.940452:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787665.940512:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744835968 00000100:00100000:3.0:1785787665.940521:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744835968 00000100:00100000:3.0:1785787665.940576:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 114 00000100:00100000:3.0:1785787665.940586:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077088380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+55:10578:x1872533744835968:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785787665.940617:0:9295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787665.940638:0:9295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84cab lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd4a5 expref: -99 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787665.940729:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84cb2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787665.940745:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787665.940756:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785787665.940768:0:9295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1785787665.940903:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787665.940911:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84cb2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787665.940918:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84cb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787665.940938:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787665.940942:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84cb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787665.940949:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84cb2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787665.940961:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919055acd300) 00010000:00010000:3.0:1785787665.940964:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785787665.940968:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84cb2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787665.940974:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84cb2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787665.941012:0:9295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84cab lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4a5 expref: 57 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787665.941023:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9190481f9400) 00010000:00010000:3.0:1785787665.941025:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785787665.941030:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84cab lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4a5 expref: 57 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787665.941039:0:9295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f903000, rc 0) 00000100:00100000:3.0:1785787665.941087:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077088380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+56:10578:x1872533744835968:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 503us (641us total) trans 4294967397 rc 301/301 00000100:00100000:3.0:1785787665.941105:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 114 00000100:00100000:3.0:1785787665.953640:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787665.953764:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744836096 00000100:00100000:0.0:1785787665.953773:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744836096 00000100:00100000:0.0:1785787665.953839:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 115 00000100:00100000:0.0:1785787665.953848:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905c5fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+56:10578:x1872533744836096:12345-192.168.203.53@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1785787665.953888:0:5822:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1785787665.953984:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905c5fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+56:10578:x1872533744836096:12345-192.168.203.53@tcp:53:lhsmtool_posix.0 Request processed in 137us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787665.953990:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 115 00000100:00100000:1.0:1785787665.972849:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787665.972944:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744836352 00000100:00100000:2.0:1785787665.972953:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744836352 00000100:00100000:2.0:1785787665.973010:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 116 00000100:00100000:2.0:1785787665.973019:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+56:10578:x1872533744836352:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1785787665.973038:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787665.973041:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1785787665.973066:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84c50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd489 expref: 56 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.973085:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9190481f9e00) 00010000:00010000:2.0:1785787665.973090:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785787665.973102:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84cc0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd4ac expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785787665.973489:0:5821:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1785787665.973674:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84cc7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.973687:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.973712:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.973757:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84cc0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4ac expref: 58 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.973771:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84cc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4ac expref: 57 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787665.973779:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9190481f9200) 00010000:00010000:2.0:1785787665.973782:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785787665.973784:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677da00, rc 0) 00000100:00100000:2.0:1785787665.974044:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+57:10578:x1872533744836352:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 1025us (1226us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1785787665.974052:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 116 00000100:00100000:2.0:1785787665.981420:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787665.981549:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744836608 00000100:00100000:1.0:1785787665.981570:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744836608 00000100:00100000:1.0:1785787665.981635:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 117 00000100:00100000:1.0:1785787665.981644:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+57:10578:x1872533744836608:12345-192.168.203.53@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1785787665.981696:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785787665.981722:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84cc7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4ac expref: 57 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.981741:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9190481f9200) 00010000:00010000:1.0:1785787665.981750:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785787665.981769:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84cd5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.981781:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84cd5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.981790:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84cd5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.981803:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84cdc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xa29eaa9c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.981809:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84cdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa29eaa9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.981815:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84cdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa29eaa9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.981914:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84cd5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.981923:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84cd5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.981936:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84cd5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.981942:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0ea00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787665.981946:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84cd5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.981954:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84cd5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.981963:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9190481f9e00) 00010000:00010000:1.0:1785787665.981966:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785787665.981969:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84cd5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.981975:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84cd5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.981984:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84cdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa29eaa9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.981990:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84cdc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa29eaa9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.981995:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84cdc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa29eaa9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.982000:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0fe00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787665.982002:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84cdc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa29eaa9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.982017:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84cdc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa29eaa9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.982025:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xa29eaa9c (ffff91905685f300) 00010000:00010000:1.0:1785787665.982027:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785787665.982030:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84cdc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa29eaa9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787665.982034:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84cdc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa29eaa9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787665.982108:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+56:10578:x1872533744836608:12345-192.168.203.53@tcp:36:lhsmtool_posix.0 Request processed in 463us (692us total) trans 0 rc -2/-2 00000100:00100000:1.0:1785787665.982115:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 117 00000100:00100000:0.0:1785787665.985652:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787665.985726:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744836736 00000100:00100000:3.0:1785787665.985734:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744836736 00000100:00100000:3.0:1785787665.985782:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 118 00000100:00100000:3.0:1785787665.985790:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+56:10578:x1872533744836736:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785787665.985918:0:9295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787665.985939:0:9295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84ce3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd4b3 expref: -99 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787665.985970:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84cea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787665.985986:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84cea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787665.985996:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84cea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787665.986076:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e84ce3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4b3 expref: 58 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787665.987157:0:9295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84cea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4b3 expref: 57 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787665.987168:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff919055acdd00) 00010000:00010000:3.0:1785787665.987170:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1785787665.987173:0:9295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f903800, rc 0) 00000100:00100000:3.0:1785787665.987226:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+57:10578:x1872533744836736:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 1437us (1581us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787665.987233:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 118 00000100:00100000:3.0:1785787665.996946:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787665.997132:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744836992 00000100:00100000:0.0:1785787665.997142:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744836992 00000100:00100000:0.0:1785787665.997202:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 119 00000100:00100000:0.0:1785787665.997212:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905c5f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+57:10578:x1872533744836992:12345-192.168.203.53@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1785787665.997284:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919050678000/0xe2c2ff68a6e84cf1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787665.997298:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919050678000/0xe2c2ff68a6e84cf1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787665.997309:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919050678000/0xe2c2ff68a6e84cf1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785787665.997541:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:0.0:1785787665.997631:0:5822:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005d176a63 reply state 0000000070faf3d2 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff919050678000/0xe2c2ff68a6e84cf1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787665.997640:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785787665.997724:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905c5f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+59:10578:x1872533744836992:12345-192.168.203.53@tcp:36:lhsmtool_posix.0 Request processed in 513us (784us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1785787665.997731:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 119 00010000:00010000:0.0:1785787666.001898:0:3319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919050678000/0xe2c2ff68a6e84cf1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.001933:0:3319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919050678000/0xe2c2ff68a6e84cf1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.001941:0:3319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919050678000/0xe2c2ff68a6e84cf1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.001947:0:3319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919050678000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1785787666.001952:0:3319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919050678000/0xe2c2ff68a6e84cf1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.001960:0:3319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919050678000/0xe2c2ff68a6e84cf1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.001974:0:3319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff919055acdd00) 00010000:00010000:0.0:1785787666.001977:0:3319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1785787666.001982:0:3319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919050678000/0xe2c2ff68a6e84cf1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.001988:0:3319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919050678000/0xe2c2ff68a6e84cf1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787666.006147:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787666.006411:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744837120 00000100:00100000:0.0:1785787666.006420:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744837120 00000100:00100000:0.0:1785787666.006490:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 120 00000100:00100000:0.0:1785787666.006499:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+58:10578:x1872533744837120:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1785787666.006523:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787666.006542:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919050678600/0xe2c2ff68a6e84cf8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd4ba expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.006611:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919050678600/0xe2c2ff68a6e84cf8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4ba expref: 59 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.006638:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919050678600/0xe2c2ff68a6e84cf8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4ba expref: 59 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.006657:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff919055acdd00) 00010000:00010000:0.0:1785787666.006660:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1785787666.006663:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919050678600, rc 0) 00000100:00100000:0.0:1785787666.006716:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+59:10578:x1872533744837120:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 218us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787666.006723:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 120 00000100:00100000:2.0:1785787666.020378:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787666.020497:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744837248 00000100:00100000:3.0:1785787666.020507:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744837248 00000100:00100000:3.0:1785787666.020561:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 37 00000100:00100000:3.0:1785787666.020570:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:79280304-55c6-4698-bfc3-29d14648ba45+8:2391:x1872533744837248:12345-192.168.203.53@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1785787666.020859:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:79280304-55c6-4698-bfc3-29d14648ba45+9:2391:x1872533744837248:12345-192.168.203.53@tcp:2:lhsmtool_posix.0 Request processed in 289us (497us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1785787666.020867:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 37 00000100:00100000:1.0:1785787666.034081:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787666.034170:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744837504 00000100:00100000:0.0:1785787666.034179:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744837504 00000100:00100000:0.0:1785787666.034239:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 30 00000100:00100000:0.0:1785787666.034250:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+59:10578:x1872533744837504:12345-192.168.203.53@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1785787666.034575:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+60:10578:x1872533744837504:12345-192.168.203.53@tcp:35:lhsmtool_posix.0 Request processed in 326us (502us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1785787666.034584:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 30 00000100:00100000:1.0:1785787666.048204:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787666.048296:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744837760 00000100:00100000:0.0:1785787666.048305:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744837760 00000100:00100000:0.0:1785787666.048370:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 121 00000100:00100000:0.0:1785787666.048380:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+60:10578:x1872533744837760:12345-192.168.203.53@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1785787666.048486:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+60:10578:x1872533744837760:12345-192.168.203.53@tcp:57:lhsmtool_posix.0 Request processed in 106us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787666.048493:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 121 00000100:00100000:2.0:1785787666.056773:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787666.056870:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744837888 00000100:00100000:0.0:1785787666.056890:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744837888 00000100:00100000:0.0:1785787666.056986:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 122 00000100:00100000:0.0:1785787666.056996:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076edd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+60:10578:x1872533744837888:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1785787666.057014:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787666.057034:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919050678000/0xe2c2ff68a6e84cff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd4c1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.057092:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919050678800/0xe2c2ff68a6e84d06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.057104:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919050678800/0xe2c2ff68a6e84d06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.057114:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919050678800/0xe2c2ff68a6e84d06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785787666.057145:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1785787666.057161:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919050678800/0xe2c2ff68a6e84d06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.057185:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919050678000/0xe2c2ff68a6e84cff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4c1 expref: 62 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.057201:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919050678800/0xe2c2ff68a6e84d06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4c1 expref: 61 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.057208:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff919055acdd00) 00010000:00010000:0.0:1785787666.057211:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1785787666.057214:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919050678800, rc 0) 00000100:00100000:0.0:1785787666.057261:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076edd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+61:10578:x1872533744837888:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 266us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787666.057273:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 122 00000100:00100000:3.0:1785787666.061482:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787666.061603:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744838016 00000100:00100000:2.0:1785787666.061612:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744838016 00000100:00100000:2.0:1785787666.061661:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 38 00000100:00100000:2.0:1785787666.061670:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:79280304-55c6-4698-bfc3-29d14648ba45+9:2390:x1872533744838016:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1785787666.061686:0:6617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787666.061702:0:6617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007bd992d8/0xe2c2ff68a6e84d0d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd4c8 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785787666.061741:0:6617:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a70f512, blocks: 0x1 00010000:00010000:2.0:1785787666.061757:0:6617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=453s v=(0 0) 00010000:00010000:2.0:1785787666.061761:0:6617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785787666.061768:0:6617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007bd992d8/0xe2c2ff68a6e84d0d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4c8 expref: 10 pid: 6617 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.061783:0:6617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007bd992d8/0xe2c2ff68a6e84d0d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4c8 expref: 10 pid: 6617 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.061795:0:6617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677d600, rc 0) 00000100:00100000:2.0:1785787666.061857:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:79280304-55c6-4698-bfc3-29d14648ba45+10:2390:x1872533744838016:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 187us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787666.061863:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 38 00000100:00100000:1.0:1785787666.067614:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787666.070275:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744838272 00000100:00100000:0.0:1785787666.070285:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744838272 00000100:00100000:1.0:1785787666.072654:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 123 00000100:00100000:1.0:1785787666.072667:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905267d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+61:10578:x1872533744838272:12345-192.168.203.53@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1785787666.072770:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905267d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+61:10578:x1872533744838272:12345-192.168.203.53@tcp:57:lhsmtool_posix.0 Request processed in 105us (5162us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787666.072777:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 123 00000100:00100000:3.0:1785787666.077674:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787666.077851:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744838400 00000100:00100000:0.0:1785787666.077860:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744838400 00000100:00100000:0.0:1785787666.077914:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 39 00000100:00100000:0.0:1785787666.077923:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077716d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:79280304-55c6-4698-bfc3-29d14648ba45+10:10578:x1872533744838400:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1785787666.077942:0:9394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787666.077959:0:9394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c586007e/0xe2c2ff68a6e84d14 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd4cf expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.077990:0:9394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007bd992d8/0xe2c2ff68a6e84d0d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4c8 expref: 11 pid: 6617 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.077999:0:9394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785787666.078002:0:9394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785787666.078007:0:9394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c586007e/0xe2c2ff68a6e84d14 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4cf expref: 11 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.078036:0:9394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007bd992d8/0xe2c2ff68a6e84d0d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4c8 expref: 11 pid: 6617 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.078050:0:9394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007bd992d8/0xe2c2ff68a6e84d0d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4c8 expref: 11 pid: 6617 timeout: 553 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787666.078062:0:9394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bd78e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9394:1872533770021504:192.168.203.53@tcp:104: 00000100:00100000:0.0:1785787666.078157:0:9394:0:(client.c:2702:ptlrpc_set_wait()) set ffff91907bb28b40 going to sleep for 11 seconds 00000100:00100000:1.0:1785787666.085125:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787666.085321:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744838528 00000100:00100000:3.0:1785787666.085333:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744838528 00010000:00010000:3.0:1785787666.085379:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007bd992d8/0xe2c2ff68a6e84d0d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4c8 expref: 12 pid: 6617 timeout: 553 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787666.085419:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 53 00000100:00100000:3.0:1785787666.085428:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79280304-55c6-4698-bfc3-29d14648ba45+12:2390:x1872533744838528:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785787666.085441:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787666.085469:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007bd992d8/0xe2c2ff68a6e84d0d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4c8 expref: 12 pid: 6617 timeout: 553 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.085483:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007bd992d8/0xe2c2ff68a6e84d0d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4c8 expref: 12 pid: 6617 timeout: 553 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.085507:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785787666.085523:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785787666.085531:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c586007e/0xe2c2ff68a6e84d14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4cf expref: 12 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.085541:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c586007e/0xe2c2ff68a6e84d14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4cf expref: 12 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.085574:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c586007e/0xe2c2ff68a6e84d14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4cf expref: 12 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787666.085604:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077714000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5806:1872533770021632:192.168.203.53@tcp:105: 00000100:00100000:3.0:1785787666.085682:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190507db6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785787666.089508:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077714000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5806:1872533770021632:192.168.203.53@tcp:105: 00010000:00010000:1.0:1785787666.089533:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785787666.089584:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79280304-55c6-4698-bfc3-29d14648ba45+12:2390:x1872533744838528:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 4157us (4466us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787666.089615:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 53 00010000:00010000:0.0:1785787666.092558:0:9394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007bd992d8/0xe2c2ff68a6e84d0d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4c8 expref: 11 pid: 6617 timeout: 553 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787666.092579:0:9394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bd78e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9394:1872533770021504:192.168.203.53@tcp:104: 00010000:00010000:0.0:1785787666.092614:0:9394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c586007e/0xe2c2ff68a6e84d14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4cf expref: 10 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.092628:0:9394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919050678000, rc 0) 00000100:00100000:0.0:1785787666.094207:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077716d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:79280304-55c6-4698-bfc3-29d14648ba45+10:10578:x1872533744838400:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 16279us (16534us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787666.094217:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 39 00000100:00100000:1.0:1785787666.104926:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787666.105057:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744838656 00000100:00100000:3.0:1785787666.105067:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744838656 00002000:00100000:3.0:1785787666.105120:0:6624:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff91907fe14380 x1872533744838656/t0(0) o4->79280304-55c6-4698-bfc3-29d14648ba45@192.168.203.53@tcp:522/0 lens 504/0 e 0 to 0 dl 1785787677 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785787666.105131:0:6624:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91907fe14380 with x1872533744838656 ext(0->12) 00002000:00010000:3.0:1785787666.105137:0:6624:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91907fe14380 00000100:00100000:3.0:1785787666.105167:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2 00000100:00100000:3.0:1785787666.105177:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:79280304-55c6-4698-bfc3-29d14648ba45+10:2391:x1872533744838656:12345-192.168.203.53@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1785787666.105734:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:79280304-55c6-4698-bfc3-29d14648ba45+12:2391:x1872533744838656:12345-192.168.203.53@tcp:4:lhsmtool_posix.0 Request processed in 557us (815us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1785787666.105743:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2 00002000:00100000:3.0:1785787666.105749:0:6624:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff91907fe14380 x1872533744838656/t4294967308(0) o4->79280304-55c6-4698-bfc3-29d14648ba45@192.168.203.53@tcp:522/0 lens 504/448 e 0 to 0 dl 1785787677 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785787666.105770:0:6624:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91907fe14380 with x1872533744838656 ext(0->12) 00002000:00010000:3.0:1785787666.105774:0:6624:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91907fe14380 00000100:00100000:2.0:1785787666.113179:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787666.113539:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744838784 00000100:00100000:3.0:1785787666.113548:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744838784 00000100:00100000:3.0:1785787666.113611:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 124 00000100:00100000:3.0:1785787666.113620:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076edf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+61:10578:x1872533744838784:12345-192.168.203.53@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1785787666.228710:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1785787666.228730:0:5843:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:0.0:1785787666.228778:0:5843:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1785787666.228799:0:5843:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91905159de40 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1785787666.228804:0:5843:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff91904824d200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91905159d600 00000020:00080000:0.0:1785787666.228806:0:5843:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff91904824d800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91907fd65000 00000100:00100000:1.0:1785787666.228969:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fe17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770021760:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1785787666.229023:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1785787666.229296:0:5843:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1785787666.229307:0:5843:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9190515b7cc0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1785787666.229311:0:5843:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9190468a8f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9190515b7e40 00000020:00080000:0.0:1785787666.229314:0:5843:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9190468a8600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91907b6d1c00 00000020:00080000:0.0:1785787666.229323:0:5843:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:0.0:1785787666.229348:0:5854:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1785787666.229541:0:5854:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1785787666.229847:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077714700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770021888:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1785787666.229875:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787666.230010:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770021760 00000100:00100000:3.0:1785787666.230017:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770021760 00000100:00100000:3.0:1785787666.230061:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770021888 00000100:00100000:3.0:1785787666.230064:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770021888 00000100:00100000:3.0:1785787666.230082:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1785787666.230089:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3336:x1872533770021760:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1785787666.230111:0:6619:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:3.0:1785787666.230137:0:6619:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a70f510, atime: 0x6a70f510, ctime: 0x6a70f510, blocks: 0x1 00010000:00010000:3.0:1785787666.230144:0:6619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051f52044/0xe2c2ff68a6e84d1b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.230160:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1785787666.230165:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785787666.230172:0:6619:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051f52044/0xe2c2ff68a6e84d1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.230186:0:6619:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051f52044/0xe2c2ff68a6e84d1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.230196:0:6619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051f52044/0xe2c2ff68a6e84d1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.230210:0:6619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051f52044/0xe2c2ff68a6e84d1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.230223:0:6619:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1785787666.230691:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3336:x1872533770021760:12345-0@lo:6:osp-syn-0-0.0 Request processed in 601us (1666us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1785787666.230697:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1785787666.230711:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1785787666.230717:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3333:x1872533770021888:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1785787666.230730:0:6619:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:3.0:1785787666.230741:0:6619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b3a3c20/0xe2c2ff68a6e84d22 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.230755:0:6619:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000078014ab1/0xe2c2ff68a6e84add lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd42e expref: 11 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.230763:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1785787666.230767:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1785787666.230771:0:6619:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b3a3c20/0xe2c2ff68a6e84d22 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.230793:0:6619:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000078014ab1/0xe2c2ff68a6e84add lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd42e expref: 11 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.230806:0:6619:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000078014ab1/0xe2c2ff68a6e84add lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd42e expref: 11 pid: 9394 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787666.230928:0:6619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077714000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6619:1872533770022016:192.168.203.53@tcp:104: 00000100:00100000:3.0:1785787666.230979:0:6619:0:(client.c:2702:ptlrpc_set_wait()) set ffff91904689b780 going to sleep for 11 seconds 00000100:00080000:1.0:1785787666.231037:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1785787666.231150:0:3336:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91907fe17100/2, rc 0, transno 4294967304 00000100:00100000:1.0:1785787666.231156:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fe17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770021760:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1785787666.231330:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785787666.231336:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051f52044/0xe2c2ff68a6e84d1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.231345:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903000 already unused, calling callback (ffffffffc174c300) 00010000:00010000:0.0:1785787666.231349:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051f52044/0xe2c2ff68a6e84d1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.231358:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051f52044/0xe2c2ff68a6e84d1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.231375:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051f52044/0xe2c2ff68a6e84d1b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.231382:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051f52044/0xe2c2ff68a6e84d1b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.231400:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787666.231402:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787666.231403:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785787666.233783:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076edf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+15:10578:x1872533744838784:12345-192.168.203.53@tcp:44:lhsmtool_posix.0 Request processed in 120158us (120606us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787666.233794:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 124 00000100:00100000:1.0:1785787666.243945:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787666.244907:0:6619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077714000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6619:1872533770022016:192.168.203.53@tcp:104: 00010000:00010000:3.0:1785787666.244934:0:6619:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000b3a3c20/0xe2c2ff68a6e84d22 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787666.245074:0:11051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744838912 00000100:00100000:2.0:1785787666.245080:0:11051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744838912 00010000:00010000:2.0:1785787666.245112:0:11051:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000078014ab1/0xe2c2ff68a6e84add lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd42e expref: 12 pid: 9394 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787666.245146:0:11051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 54 00000100:00100000:2.0:1785787666.245153:0:11051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79280304-55c6-4698-bfc3-29d14648ba45+12:2391:x1872533744838912:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785787666.245180:0:11051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785787666.245185:0:11051:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000078014ab1/0xe2c2ff68a6e84add lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd42e expref: 12 pid: 9394 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.245196:0:11051:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000078014ab1/0xe2c2ff68a6e84add lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd42e expref: 12 pid: 9394 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.245215:0:11051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078014ab1/0xe2c2ff68a6e84add lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd42e expref: 12 pid: 9394 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.245230:0:11051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785787666.245233:0:11051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785787666.245238:0:11051:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000b3a3c20/0xe2c2ff68a6e84d22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.245246:0:11051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b3a3c20/0xe2c2ff68a6e84d22 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.245298:0:11051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785787666.245461:0:6619:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000b3a3c20/0xe2c2ff68a6e84d22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.245470:0:6619:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b3a3c20/0xe2c2ff68a6e84d22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.245479:0:6619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b3a3c20/0xe2c2ff68a6e84d22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.245486:0:6619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b3a3c20/0xe2c2ff68a6e84d22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.245503:0:6619:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1785787666.246064:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3333:x1872533770021888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15346us (16187us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1785787666.246073:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:3.0:1785787666.246095:0:11050:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785787666.246100:0:11050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b3a3c20/0xe2c2ff68a6e84d22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.246113:0:11050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903200 already unused, calling callback (ffffffffc174c300) 00010000:00010000:3.0:1785787666.246117:0:11050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b3a3c20/0xe2c2ff68a6e84d22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.246125:0:11050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b3a3c20/0xe2c2ff68a6e84d22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.246136:0:11050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b3a3c20/0xe2c2ff68a6e84d22 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.246142:0:11050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b3a3c20/0xe2c2ff68a6e84d22 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.246157:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787666.246159:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787666.246161:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785787666.246370:0:11051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79280304-55c6-4698-bfc3-29d14648ba45+11:2391:x1872533744838912:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 1215us (2431us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787666.246378:0:11051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 54 00000004:00080000:1.0:1785787666.248381:0:3333:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff919077714700/2, rc 0, transno 4294967309 00000100:00100000:1.0:1785787666.248405:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077714700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770021888:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1785787666.254081:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787666.254138:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744839040 00000100:00100000:3.0:1785787666.254147:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744839040 00000100:00100000:3.0:1785787666.254197:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 42 00000100:00100000:3.0:1785787666.254205:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+11:2390:x1872533744839040:12345-192.168.203.53@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1785787666.408190:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:0.0:1785787666.408204:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:0.0:1785787666.408211:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:0.0:1785787666.408216:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:1.0:1785787666.408365:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+6:2390:x1872533744839040:12345-192.168.203.53@tcp:16:lhsmtool_posix.0 Request processed in 154155us (154285us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787666.408376:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 42 00000100:00100000:0.0:1785787666.420482:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787666.420985:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744839296 00000100:00100000:2.0:1785787666.420994:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744839296 00000100:00100000:2.0:1785787666.421090:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 125 00000100:00100000:2.0:1785787666.421100:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+15:10578:x1872533744839296:12345-192.168.203.53@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1785787666.421159:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785787666.421183:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919050678800/0xe2c2ff68a6e84d06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4c1 expref: 15 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.421201:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff919055acdd00) 00010000:00010000:2.0:1785787666.421205:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785787666.421230:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e84d29 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.421242:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e84d29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.421250:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e84d29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785787666.421707:0:5820:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000030a918ee reply state 000000001a089832 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e84d29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787666.421716:0:5820:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785787666.421934:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+16:10578:x1872533744839296:12345-192.168.203.53@tcp:36:lhsmtool_posix.0 Request processed in 834us (1457us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1785787666.421940:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 125 00000100:00100000:0.0:1785787666.439950:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787666.441370:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744839424 00000100:00100000:2.0:1785787666.441381:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744839424 00000100:00100000:2.0:1785787666.441426:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 43 00000100:00100000:2.0:1785787666.441434:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:79280304-55c6-4698-bfc3-29d14648ba45+6:2390:x1872533744839424:12345-192.168.203.53@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1785787666.441663:0:6617:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1785787666.441667:0:6617:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1785787665 00002000:00010000:2.0:1785787666.441669:0:6617:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1785787664 00002000:00010000:2.0:1785787666.441681:0:6617:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1785787666 -> 1785787665 00002000:00010000:2.0:1785787666.441683:0:6617:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1785787666.441739:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:79280304-55c6-4698-bfc3-29d14648ba45+7:2390:x1872533744839424:12345-192.168.203.53@tcp:2:lhsmtool_posix.0 Request processed in 305us (1797us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1785787666.441747:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 43 00010000:00010000:3.0:1785787666.444789:0:3320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e84d29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.444804:0:3320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e84d29 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.445678:0:3320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e84d29 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.445685:0:3320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677ce00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787666.445690:0:3320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e84d29 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.445698:0:3320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e84d29 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.445713:0:3320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff919055acdd00) 00010000:00010000:3.0:1785787666.445716:0:3320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787666.445720:0:3320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e84d29 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.445726:0:3320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e84d29 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787666.452973:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787666.453073:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744839680 00000100:00100000:0.0:1785787666.453082:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744839680 00000100:00100000:0.0:1785787666.453140:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 126 00000100:00100000:0.0:1785787666.453148:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+15:10578:x1872533744839680:12345-192.168.203.53@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1785787666.453209:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919050679200/0xe2c2ff68a6e84d30 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.453223:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84cea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4b3 expref: 15 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.453230:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919050679200/0xe2c2ff68a6e84d30 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.453271:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84cea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4b3 expref: 15 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.453283:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84cea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4b3 expref: 15 pid: 9295 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787666.453295:0:5821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5821:1872533770022144:192.168.203.53@tcp:104: 00000100:00100000:0.0:1785787666.453388:0:5821:0:(client.c:2702:ptlrpc_set_wait()) set ffff91907bb28cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1785787666.454818:0:5821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5821:1872533770022144:192.168.203.53@tcp:104: 00010000:00010000:3.0:1785787666.454907:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919050679200/0xe2c2ff68a6e84d30 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787666.455515:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787666.455745:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744839808 00000100:00100000:0.0:1785787666.455750:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744839808 00010000:00010000:0.0:1785787666.455775:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84cea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4b3 expref: 16 pid: 9295 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787666.455804:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 55 00000100:00100000:0.0:1785787666.455811:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79280304-55c6-4698-bfc3-29d14648ba45+16:2390:x1872533744839808:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785787666.455845:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785787666.455851:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84cea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4b3 expref: 16 pid: 9295 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.455871:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84cea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4b3 expref: 16 pid: 9295 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.455890:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e84cea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4b3 expref: 16 pid: 9295 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.455903:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff919055acdd00) 00010000:00010000:0.0:1785787666.455908:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919050679200/0xe2c2ff68a6e84d30 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.455916:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919050679200/0xe2c2ff68a6e84d30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.455923:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919050679200/0xe2c2ff68a6e84d30 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.455944:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785787666.455977:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79280304-55c6-4698-bfc3-29d14648ba45+15:2390:x1872533744839808:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 165us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787666.455983:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 55 00010000:00010000:3.0:1785787666.456111:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919050679200/0xe2c2ff68a6e84d30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.456118:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919050679200/0xe2c2ff68a6e84d30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.456143:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919050679200/0xe2c2ff68a6e84d30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.456159:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919050679200/0xe2c2ff68a6e84d30 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.456166:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919050679200/0xe2c2ff68a6e84d30 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.456172:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919050679200 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787666.456176:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919050679200/0xe2c2ff68a6e84d30 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.456183:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919050679200/0xe2c2ff68a6e84d30 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.456192:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff919055acdd00) 00010000:00010000:3.0:1785787666.456194:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1785787666.456198:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919050679200/0xe2c2ff68a6e84d30 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.456204:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919050679200/0xe2c2ff68a6e84d30 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787666.456245:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+14:10578:x1872533744839680:12345-192.168.203.53@tcp:55:lhsmtool_posix.0 Request processed in 3097us (3279us total) trans 0 rc -22/-22 00000100:00100000:3.0:1785787666.456260:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 126 00000100:00100000:1.0:1785787666.457749:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787666.457809:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744839936 00000100:00100000:0.0:1785787666.457814:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744839936 00000100:00100000:0.0:1785787666.457873:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 44 00000100:00100000:0.0:1785787666.457881:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:79280304-55c6-4698-bfc3-29d14648ba45+7:2389:x1872533744839936:12345-192.168.203.53@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1785787666.457915:0:9394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d5fa8ab7/0xe2c2ff68a6e84d37 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.457945:0:9394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c586007e/0xe2c2ff68a6e84d14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4cf expref: 7 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.457954:0:9394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785787666.457958:0:9394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1785787666.457963:0:9394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5fa8ab7/0xe2c2ff68a6e84d37 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.457993:0:9394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c586007e/0xe2c2ff68a6e84d14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4cf expref: 7 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.458006:0:9394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c586007e/0xe2c2ff68a6e84d14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4cf expref: 7 pid: 9394 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787666.458020:0:9394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9394:1872533770022272:192.168.203.53@tcp:104: 00000100:00100000:0.0:1785787666.458087:0:9394:0:(client.c:2702:ptlrpc_set_wait()) set ffff91907bb289c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785787666.469525:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787666.470438:0:9394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9394:1872533770022272:192.168.203.53@tcp:104: 00010000:00010000:1.0:1785787666.470473:0:9394:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d5fa8ab7/0xe2c2ff68a6e84d37 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787666.470949:0:11051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744840064 00000100:00100000:3.0:1785787666.470955:0:11051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744840064 00010000:00010000:3.0:1785787666.470988:0:11051:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c586007e/0xe2c2ff68a6e84d14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4cf expref: 8 pid: 9394 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787666.471022:0:11051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 56 00000100:00100000:3.0:1785787666.471042:0:11051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ec9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79280304-55c6-4698-bfc3-29d14648ba45+8:2390:x1872533744840064:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785787666.471056:0:11051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787666.471077:0:11051:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c586007e/0xe2c2ff68a6e84d14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4cf expref: 8 pid: 9394 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.471089:0:11051:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c586007e/0xe2c2ff68a6e84d14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4cf expref: 8 pid: 9394 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.471109:0:11051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c586007e/0xe2c2ff68a6e84d14 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4cf expref: 8 pid: 9394 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.471124:0:11051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1785787666.471128:0:11051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1785787666.471134:0:11051:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5fa8ab7/0xe2c2ff68a6e84d37 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.471144:0:11051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5fa8ab7/0xe2c2ff68a6e84d37 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.471171:0:11051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787666.471218:0:11051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ec9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79280304-55c6-4698-bfc3-29d14648ba45+7:2390:x1872533744840064:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 177us (1702us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787666.471225:0:11051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 56 00010000:00010000:0.0:1785787666.471279:0:9394:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d5fa8ab7/0xe2c2ff68a6e84d37 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.471287:0:9394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5fa8ab7/0xe2c2ff68a6e84d37 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.471307:0:9394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d5fa8ab7/0xe2c2ff68a6e84d37 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.471323:0:9394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5fa8ab7/0xe2c2ff68a6e84d37 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.471330:0:9394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5fa8ab7/0xe2c2ff68a6e84d37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.471336:0:9394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919050678800 already unused, calling callback (ffffffffc174c300) 00010000:00010000:0.0:1785787666.471339:0:9394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5fa8ab7/0xe2c2ff68a6e84d37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.471345:0:9394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5fa8ab7/0xe2c2ff68a6e84d37 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.471357:0:9394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5fa8ab7/0xe2c2ff68a6e84d37 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.471363:0:9394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5fa8ab7/0xe2c2ff68a6e84d37 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787666.471421:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:79280304-55c6-4698-bfc3-29d14648ba45+6:2389:x1872533744839936:12345-192.168.203.53@tcp:1:lhsmtool_posix.0 Request processed in 13542us (13676us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787666.471427:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 44 00000100:00100000:0.0:1785787666.474189:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787666.474276:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744840320 00000100:00100000:1.0:1785787666.474294:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744840320 00000100:00100000:1.0:1785787666.474349:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 127 00000100:00100000:1.0:1785787666.474358:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+14:10578:x1872533744840320:12345-192.168.203.53@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1785787666.474428:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84d3e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787666.474443:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84d3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787666.474463:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84d3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787666.474999:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84d45 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787666.475011:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919050678600/0xe2c2ff68a6e84cf8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4ba expref: 15 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787666.475021:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84d45 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787666.475051:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919050678600/0xe2c2ff68a6e84cf8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4ba expref: 15 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787666.475063:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919050678600/0xe2c2ff68a6e84cf8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4ba expref: 15 pid: 5821 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787666.475076:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fe14a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5822:1872533770022400:192.168.203.53@tcp:104: 00000100:00100000:1.0:1785787666.475151:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905159df00 going to sleep for 11 seconds 00000100:00100000:2.0:1785787666.476738:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fe14a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5822:1872533770022400:192.168.203.53@tcp:104: 00010000:00010000:2.0:1785787666.476759:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84d45 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787666.486193:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787666.486360:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744840448 00000100:00100000:1.0:1785787666.486380:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744840448 00010000:00010000:1.0:1785787666.486415:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919050678600/0xe2c2ff68a6e84cf8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4ba expref: 16 pid: 5821 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787666.489748:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 57 00000100:00100000:1.0:1785787666.489769:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b374e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79280304-55c6-4698-bfc3-29d14648ba45+16:2391:x1872533744840448:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785787666.489786:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785787666.489796:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919050678600/0xe2c2ff68a6e84cf8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4ba expref: 16 pid: 5821 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787666.489813:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919050678600/0xe2c2ff68a6e84cf8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4ba expref: 16 pid: 5821 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787666.489854:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919050678600/0xe2c2ff68a6e84cf8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4ba expref: 16 pid: 5821 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787666.489869:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff919055acdd00) 00010000:00010000:1.0:1785787666.489874:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84d45 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787666.489883:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84d45 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787666.489890:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84d45 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787666.489961:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785787666.490011:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b374e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79280304-55c6-4698-bfc3-29d14648ba45+15:2391:x1872533744840448:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 252us (3825us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787666.490031:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 57 00010000:00010000:0.0:1785787666.493383:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84d45 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.493414:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84d45 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785787666.494028:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1785787666.494177:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1785787666.494224:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1785787666.495063:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b377800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5822:1872533770022528:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1785787666.495120:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787666.495184:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff91907bb28000 going to sleep for 11 seconds 00000100:00100000:1.0:1785787666.497736:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770022528 00000100:00100000:1.0:1785787666.497747:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770022528 00000100:00100000:1.0:1785787666.497864:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1785787666.497873:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5822:x1872533770022528:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1785787666.497958:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5822:x1872533770022528:12345-0@lo:1000:mdt00_002.0 Request processed in 87us (2838us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787666.497965:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1785787666.498043:0:5822:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1785787666.498048:0:5822:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:0.0:1785787666.498064:0:5822:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff919077714700, transno 4294967309 00000100:00100000:0.0:1785787666.498083:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b377800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5822:1872533770022528:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1785787666.498532:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1785787666.498617:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b377800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5822:1872533770022656:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1785787666.498660:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787666.506167:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff91907bb283c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785787666.507555:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770022656 00000100:00100000:3.0:1785787666.507565:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770022656 00000100:00100000:2.0:1785787666.509517:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1785787666.509528:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5822:x1872533770022656:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1785787666.510060:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5822:x1872533770022656:12345-0@lo:1000:mdt00_002.0 Request processed in 532us (11399us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1785787666.510067:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1785787666.510142:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b377800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5822:1872533770022656:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1785787666.510182:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84d45 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.510191:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84d45 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.510197:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84d45 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.510202:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0fe00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1785787666.510218:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84d45 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.510225:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84d45 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.510238:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff919055acdd00) 00010000:00010000:0.0:1785787666.510241:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1785787666.510245:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84d45 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.510250:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84d45 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.510288:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84c88 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.510293:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84c88 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.510298:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84c88 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.510302:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0ec00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1785787666.510304:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84c88 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.510309:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84c88 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.510315:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919055acd300) 00010000:00010000:0.0:1785787666.510316:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1785787666.510327:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e84c8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd49e expref: 18 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.510338:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e84c8f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd49e expref: 18 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.510347:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e84c8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd49e expref: 18 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.510381:0:5822:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e84c8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd49e expref: 18 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787666.510394:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919048780380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5822:1872533770022784:192.168.203.53@tcp:105: 00000100:00100000:0.0:1785787666.510476:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff91907bb283c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785787666.516981:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919048780380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5822:1872533770022784:192.168.203.53@tcp:105: 00010000:00010000:2.0:1785787666.517012:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84c88 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.517022:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84c88 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.517055:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84d4c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.517066:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84d4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.517076:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84d4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.517096:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84d4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.517102:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84d4c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.517107:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84d4c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.517112:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677d800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787666.517115:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84d4c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.517120:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84d4c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.517129:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919055acd300) 00010000:00010000:2.0:1785787666.517131:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787666.517134:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84d4c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.517138:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84d4c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.517146:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84d3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.517151:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84d3e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.517155:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84d3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.517163:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0e400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787666.517166:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84d3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.517171:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84d3e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.517176:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919055acd300) 00010000:00010000:2.0:1785787666.517178:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1785787666.517180:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84d3e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.517184:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84d3e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787666.518156:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+18:10578:x1872533744840320:12345-192.168.203.53@tcp:57:lhsmtool_posix.0 Request processed in 43796us (43970us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1785787666.518167:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 127 00000020:00080000:2.0:1785787666.518172:0:5822:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1785787666.520571:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787666.520695:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744840576 00000100:00100000:3.0:1785787666.520703:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744840576 00000100:00100000:3.0:1785787666.520765:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 31 00000100:00100000:3.0:1785787666.520774:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+18:10577:x1872533744840576:12345-192.168.203.53@tcp:49:lfs.0 00000100:00100000:3.0:1785787666.520923:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+18:10577:x1872533744840576:12345-192.168.203.53@tcp:49:lfs.0 Request processed in 150us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787666.520929:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 31 00000040:00080000:0.0:1785787666.521488:0:11564:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1785787666.521493:0:11564:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1785787666.523508:0:11564:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1785787666.523521:0:11564:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1785787666.529463:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787666.529541:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787666.529737:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744841088 00000100:00100000:0.0:1785787666.529745:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744841088 00000100:00100000:0.0:1785787666.529794:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 32 00000100:00100000:0.0:1785787666.529802:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190451bc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+18:10578:x1872533744841088:12345-192.168.203.53@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1785787666.530546:0:5824:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1785787666.530720:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1785787666.530765:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919050678800/0xe2c2ff68a6e84d53 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.530781:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919050678800/0xe2c2ff68a6e84d53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.530800:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919050678800/0xe2c2ff68a6e84d53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.530809:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919050678800/0xe2c2ff68a6e84d53 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.530815:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919050678800/0xe2c2ff68a6e84d53 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787666.530959:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744840832 00000100:00100000:3.0:1785787666.530964:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744840832 00000100:00100000:3.0:1785787666.531000:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 128 00000100:00100000:3.0:1785787666.531007:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+21:10577:x1872533744840832:12345-192.168.203.53@tcp:58:lfs.0 00000040:00080000:3.0:1785787666.531155:0:9295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00010000:00010000:0.0:1785787666.531877:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919050678800/0xe2c2ff68a6e84d53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787666.531892:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785787666.531967:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785787666.531974:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919050678800/0xe2c2ff68a6e84d53 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787666.531981:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919050678800 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785787666.531985:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919050678800/0xe2c2ff68a6e84d53 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787666.531993:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919050678800/0xe2c2ff68a6e84d53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787666.532005:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff919059e3eb00) 00010000:00010000:1.0:1785787666.532008:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785787666.532013:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919050678800/0xe2c2ff68a6e84d53 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787666.532019:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919050678800/0xe2c2ff68a6e84d53 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787666.532047:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787666.532049:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787666.532051:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787666.534065:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+21:10577:x1872533744840832:12345-192.168.203.53@tcp:58:lfs.0 Request processed in 3050us (4612us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787666.534077:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 128 00000100:00100000:0.0:1785787666.538394:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190451bc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+20:10578:x1872533744841088:12345-192.168.203.53@tcp:35:lhsmtool_posix.0 Request processed in 8583us (8843us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1785787666.538406:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 32 00000020:00080000:0.0:1785787666.538412:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785787666.615682:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787666.618755:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744841216 00000100:00100000:2.0:1785787666.618768:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744841216 00000100:00100000:2.0:1785787666.618933:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 129 00000100:00100000:2.0:1785787666.618945:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+20:10580:x1872533744841216:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:2.0:1785787666.618968:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787666.618989:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84d5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd4d6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.619070:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84d61 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.619084:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84d61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.619096:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84d61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.619111:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84d68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.619119:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84d68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.619125:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84d68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.619424:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84d6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.619435:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84c7a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd497 expref: 21 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.619444:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84d6f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.619486:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84c7a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd497 expref: 21 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.619511:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84c7a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd497 expref: 21 pid: 5822 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787666.619525:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076eded80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5820:1872533770022912:192.168.203.53@tcp:104: 00000100:00100000:2.0:1785787666.619635:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff91904830bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1785787666.623866:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787666.623958:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744841472 00000100:00100000:1.0:1785787666.623966:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744841472 00000100:00100000:1.0:1785787666.624017:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 33 00000100:00100000:1.0:1785787666.624025:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076edfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+22:5608:x1872533744841472:12345-192.168.203.53@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1785787666.624222:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076edfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+23:5608:x1872533744841472:12345-192.168.203.53@tcp:35:ldlm_bl.0 Request processed in 196us (361us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1785787666.624229:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 33 00000100:00100000:3.0:1785787666.626496:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076eded80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5820:1872533770022912:192.168.203.53@tcp:104: 00010000:00010000:3.0:1785787666.626520:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84d6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787666.630045:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787666.632974:0:11051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744841600 00000100:00100000:3.0:1785787666.632985:0:11051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744841600 00010000:00010000:3.0:1785787666.633027:0:11051:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84c7a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd497 expref: 23 pid: 5822 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787666.633108:0:11051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 58 00000100:00100000:3.0:1785787666.633118:0:11051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79280304-55c6-4698-bfc3-29d14648ba45+23:2391:x1872533744841600:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785787666.633133:0:11051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787666.633152:0:11051:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84c7a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd497 expref: 23 pid: 5822 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.633165:0:11051:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84c7a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd497 expref: 23 pid: 5822 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.633185:0:11051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84c7a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd497 expref: 23 pid: 5822 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.633201:0:11051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919055acd300) 00010000:00010000:3.0:1785787666.633206:0:11051:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84d6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.633216:0:11051:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84d6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.633223:0:11051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84d6f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787666.634447:0:11051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787666.634509:0:11051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79280304-55c6-4698-bfc3-29d14648ba45+22:2391:x1872533744841600:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 1391us (4470us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787666.634517:0:11051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 58 00010000:00010000:2.0:1785787666.634677:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84d6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.634685:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84d6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787666.634722:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1785787666.634726:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785787666.634743:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84d6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.634754:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84d6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.634762:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84d61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.634768:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84d61 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.634773:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84d61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.634778:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677d200 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787666.634789:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84d61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.634796:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84d61 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.634804:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9190481f9e00) 00010000:00010000:2.0:1785787666.634807:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787666.634810:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84d61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.634815:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84d61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.634862:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84d68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.634868:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84d68 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.634873:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84d68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.634877:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677d000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787666.634879:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84d68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.634883:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84d68 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.634889:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9190481f9300) 00010000:00010000:2.0:1785787666.634891:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787666.634901:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84d68 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.634907:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84d68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.634937:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84d5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4d6 expref: 22 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.634949:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84d6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4d6 expref: 21 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787666.634954:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919055acd300) 00010000:00010000:2.0:1785787666.634956:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785787666.634958:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677dc00, rc 0) 00000100:00100000:2.0:1785787666.634999:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+21:10580:x1872533744841216:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 16058us (19325us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787666.635005:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 129 00010000:00010000:0.0:1785787666.935871:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1785787667.559393:0:11986:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1785787667.559402:0:11986:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1785787667.559457:0:11986:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1785787667.559463:0:11986:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1785787667.571192:0:11564:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1785787667.571199:0:11564:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1785787667.571231:0:11564:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1785787667.571236:0:11564:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1785787667.571359:0:11564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11564:1872533770023040:192.168.203.53@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1785787667.571446:0:11564:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905159da80 going to sleep for 11 seconds 00000100:00100000:3.0:1785787667.578303:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787667.578343:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744841728 00000100:00100000:3.0:1785787667.578350:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744841728 00000100:00100000:3.0:1785787667.578398:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 130 00000100:00100000:3.0:1785787667.578408:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+22:10591:x1872533744841728:12345-192.168.203.53@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1785787667.578436:0:5821:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1785787667.578548:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+22:10591:x1872533744841728:12345-192.168.203.53@tcp:53:lhsmtool_posix.0 Request processed in 142us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787667.578554:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 130 00000100:00080000:3.0:1785787667.578571:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785787667.580840:0:11564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11564:1872533770023040:192.168.203.53@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1785787667.582980:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787667.584802:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744841984 00000100:00100000:1.0:1785787667.584811:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744841984 00000100:00100000:1.0:1785787667.584882:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 131 00000100:00100000:1.0:1785787667.584892:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+21:10591:x1872533744841984:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1785787667.584925:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787667.584947:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84d76 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd4dd expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787667.585028:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84d7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787667.585042:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84d7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787667.585053:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84d7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785787667.585064:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1785787667.585179:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84d76 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4dd expref: 24 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787667.585197:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84d7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4dd expref: 23 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787667.585205:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919055acd300) 00010000:00010000:1.0:1785787667.585208:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785787667.585211:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919043c0ea00, rc 0) 00000100:00100000:1.0:1785787667.585264:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+23:10591:x1872533744841984:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 374us (2287us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1785787667.585271:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 131 00000100:00100000:3.0:1785787667.599129:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787667.599214:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787667.599247:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744842112 00000100:00100000:3.0:1785787667.599257:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744842112 00000100:00100000:3.0:1785787667.599351:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 10 00000100:00100000:3.0:1785787667.599361:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051464050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79280304-55c6-4698-bfc3-29d14648ba45+23:2391:x1872533744842112:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785787667.599376:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787667.599399:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84d7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4dd expref: 23 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787667.599415:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919055acd300) 00010000:00010000:3.0:1785787667.599420:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787667.599468:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051464050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79280304-55c6-4698-bfc3-29d14648ba45+22:2391:x1872533744842112:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 109us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787667.599476:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 10 00000100:00100000:1.0:1785787667.602979:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744842368 00000100:00100000:1.0:1785787667.602991:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744842368 00000100:00100000:1.0:1785787667.603040:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 132 00000100:00100000:1.0:1785787667.603058:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+22:10591:x1872533744842368:12345-192.168.203.53@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1785787667.603129:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84d8b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787667.603144:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84d8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787667.603156:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84d8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787667.605447:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84d8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787667.605458:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84d8b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787667.605465:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84d8b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787667.605471:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0fa00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787667.605475:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84d8b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787667.605481:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84d8b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787667.605495:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919055acd300) 00010000:00010000:1.0:1785787667.605497:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1785787667.605501:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84d8b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787667.605508:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e84d8b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787667.605877:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+23:10591:x1872533744842368:12345-192.168.203.53@tcp:57:lhsmtool_posix.0 Request processed in 2819us (6659us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1785787667.605886:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 132 00000040:00080000:0.0:1785787667.605957:0:11564:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1785787667.605961:0:11564:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1785787667.606527:0:11564:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1785787667.606536:0:11564:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1785787667.620866:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787667.621823:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744842624 00000100:00100000:1.0:1785787667.621845:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744842624 00000100:00100000:1.0:1785787667.621899:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 34 00000100:00100000:1.0:1785787667.621909:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+23:10591:x1872533744842624:12345-192.168.203.53@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1785787667.622125:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+24:10591:x1872533744842624:12345-192.168.203.53@tcp:35:lhsmtool_posix.0 Request processed in 217us (1266us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1785787667.622134:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 34 00000100:00100000:0.0:1785787667.890999:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770023168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785787667.891064:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787667.891258:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770023168 00000100:00100000:3.0:1785787667.891266:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770023168 00000100:00100000:3.0:1785787667.891316:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1785787667.891403:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048782a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3334:x1872533770023168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785787667.891436:0:6620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785787667.891490:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048782a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3334:x1872533770023168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787667.891512:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1785787667.891604:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770023168:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1785787667.955617:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1785787668.481955:0:6642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:0.0:1785787668.481971:0:6642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1785787668.481977:0:6642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00010000:00010000:1.0:1785787668.980492:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1785787669.766279:0:12037:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1785787669.766292:0:12037:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1785787669.767614:0:12037:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1785787669.767622:0:12037:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1785787670.004007:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787670.056763:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787670.056856:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744842880 00000100:00100000:1.0:1785787670.056865:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744842880 00000100:00100000:1.0:1785787670.056928:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 133 00000100:00100000:1.0:1785787670.056938:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+24:10613:x1872533744842880:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:1.0:1785787670.056960:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787670.056981:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84d92 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd4e4 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787670.057075:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84d99 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787670.057089:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84d99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787670.057111:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84d99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785787670.057123:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1785787670.057241:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ec00/0xe2c2ff68a6e84d92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4e4 expref: 27 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787670.057258:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84d99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4e4 expref: 26 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787670.057268:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919055acd300) 00010000:00010000:1.0:1785787670.057271:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1785787670.057274:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919043c0e400, rc 0) 00000100:00100000:1.0:1785787670.057322:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+26:10613:x1872533744842880:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 386us (618us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1785787670.057329:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 133 00000100:00080000:0.0:1785787670.057853:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785787670.063277:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787670.063306:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744843008 00000100:00100000:3.0:1785787670.063313:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744843008 00000100:00100000:3.0:1785787670.063365:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 134 00000100:00100000:3.0:1785787670.063374:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+26:10613:x1872533744843008:12345-192.168.203.53@tcp:54:lfs.0 00010000:00010000:3.0:1785787670.063436:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84da7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787670.063451:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84da7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787670.063463:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84da7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787670.063489:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84da7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787670.063495:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84da7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787670.063503:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84da7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787670.063510:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903e00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787670.063514:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84da7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787670.063521:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84da7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787670.063541:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919055acd300) 00010000:00010000:3.0:1785787670.063544:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785787670.063549:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84da7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787670.063556:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84da7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787670.063635:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+26:10613:x1872533744843008:12345-192.168.203.53@tcp:54:lfs.0 Request processed in 262us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787670.063643:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 134 00000100:00100000:0.0:1785787670.127763:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787670.127864:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744843136 00000100:00100000:2.0:1785787670.127874:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744843136 00000100:00100000:2.0:1785787670.127945:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 45 00000100:00100000:2.0:1785787670.127957:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:79280304-55c6-4698-bfc3-29d14648ba45+6:2391:x1872533744843136:12345-192.168.203.53@tcp:101:cat.0 00010000:00010000:2.0:1785787670.127975:0:6617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787670.127995:0:6617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000fda141e/0xe2c2ff68a6e84dae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd4eb expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785787670.128021:0:6617:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a70f511, atime: 0x6a70f510, ctime: 0x6a70f511, blocks: 0xb 00010000:00010000:2.0:1785787670.128041:0:6617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=457s v=(0 0) 00010000:00010000:2.0:1785787670.128057:0:6617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785787670.128066:0:6617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fda141e/0xe2c2ff68a6e84dae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4eb expref: 7 pid: 6617 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787670.128086:0:6617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000fda141e/0xe2c2ff68a6e84dae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4eb expref: 7 pid: 6617 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787670.128099:0:6617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677c400, rc 0) 00000100:00100000:2.0:1785787670.128155:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:79280304-55c6-4698-bfc3-29d14648ba45+7:2391:x1872533744843136:12345-192.168.203.53@tcp:101:cat.0 Request processed in 201us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787670.128161:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 45 00000100:00080000:0.0:1785787670.128589:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785787670.145787:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787670.145863:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787670.145892:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787670.145932:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787670.145961:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744843648 00000100:00100000:0.0:1785787670.145970:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744843648 00000100:00100000:0.0:1785787670.146031:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 167 00000100:00100000:0.0:1785787670.146041:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4ec65b7-e63e-42dc-becf-cba362002085+5:2388:x1872533744843648:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1785787670.146116:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4ec65b7-e63e-42dc-becf-cba362002085+5:2388:x1872533744843648:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 77us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787670.146125:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 167 00000100:00080000:0.0:1785787670.146149:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785787670.146344:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744843520 00000100:00100000:1.0:1785787670.146349:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744843520 00000100:00100000:1.0:1785787670.146400:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 93 00000100:00100000:1.0:1785787670.146408:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+5:2388:x1872533744843520:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1785787670.146448:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+5:2388:x1872533744843520:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 40us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787670.146455:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 93 00000100:00080000:0.0:1785787670.146635:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785787670.146692:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744843392 00000100:00100000:2.0:1785787670.146697:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744843392 00000100:00100000:2.0:1785787670.146730:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 303 00000100:00100000:2.0:1785787670.146737:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051506850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2388:x1872533744843392:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:2.0:1785787670.146779:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051506850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2388:x1872533744843392:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 42us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787670.146785:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 303 00000100:00100000:3.0:1785787670.147388:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744843264 00000100:00100000:3.0:1785787670.147394:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744843264 00002000:00100000:3.0:1785787670.147437:0:6623:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff919048783b80 x1872533744843264/t0(0) o3->79280304-55c6-4698-bfc3-29d14648ba45@192.168.203.53@tcp:526/0 lens 488/0 e 0 to 0 dl 1785787681 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785787670.147448:0:6623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff919048783b80 with x1872533744843264 ext(0->4095) 00002000:00010000:3.0:1785787670.147454:0:6623:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff919048783b80 00000100:00100000:3.0:1785787670.147483:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 3 00000100:00100000:3.0:1785787670.147491:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:79280304-55c6-4698-bfc3-29d14648ba45+7:2388:x1872533744843264:12345-192.168.203.53@tcp:3:cat.0 00000100:00100000:3.0:1785787670.147907:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:79280304-55c6-4698-bfc3-29d14648ba45+7:2388:x1872533744843264:12345-192.168.203.53@tcp:3:cat.0 Request processed in 416us (2128us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1785787670.147914:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 3 00002000:00100000:3.0:1785787670.147921:0:6623:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff919048783b80 x1872533744843264/t0(0) o3->79280304-55c6-4698-bfc3-29d14648ba45@192.168.203.53@tcp:526/0 lens 488/4536 e 0 to 0 dl 1785787681 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785787670.147929:0:6623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff919048783b80 with x1872533744843264 ext(0->4095) 00002000:00010000:3.0:1785787670.147939:0:6623:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff919048783b80 00000100:00100000:0.0:1785787670.451132:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905069fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3333:1872533770023552:0@lo:400:kworker.0 00000100:00100000:0.0:1785787670.451191:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787670.451260:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785787670.451266:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770023680:0@lo:400:kworker.0 00000100:00100000:0.0:1785787670.451288:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787670.451317:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770023552 00000100:00100000:0.0:1785787670.451324:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770023552 00000100:00100000:3.0:1785787670.451433:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919048780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8642023-9103-4dbf-85d1-f204189bc871:3335:1872533770023296:0@lo:400:kworker.0 00000100:00100000:3.0:1785787670.451466:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787670.451489:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076ecdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3335:1872533770023808:0@lo:400:kworker.0 00000100:00100000:3.0:1785787670.451508:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787670.451523:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1785787670.451528:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bd79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3335:1872533770023424:0@lo:400:kworker.0 00000100:00100000:3.0:1785787670.451545:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787670.451569:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770023936:0@lo:400:kworker.0 00000100:00100000:3.0:1785787670.451589:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787670.451614:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770023808 00000100:00100000:3.0:1785787670.451618:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770023808 00000100:00100000:0.0:1785787670.451717:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770023424 00000100:00100000:0.0:1785787670.451721:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770023424 00000100:00100000:0.0:1785787670.451738:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1785787670.451746:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1872533770023552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787670.451809:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1872533770023552:12345-0@lo:400:kworker.0 Request processed in 63us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787670.451816:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1785787670.451854:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1785787670.451860:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907712aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3335:x1872533770023424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787670.451890:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907712aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3335:x1872533770023424:12345-0@lo:400:kworker.0 Request processed in 31us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787670.451896:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1785787670.451913:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770023296 00000100:00100000:0.0:1785787670.451917:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770023296 00000100:00100000:0.0:1785787670.451935:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1785787670.451940:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051507850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+19:3335:x1872533770023296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787670.451966:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051507850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+19:3335:x1872533770023296:12345-0@lo:400:kworker.0 Request processed in 25us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787670.451971:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1785787670.452075:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905069fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3333:1872533770023552:0@lo:400:kworker.0 00000100:00100000:1.0:1785787670.452102:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770023680 00000100:00100000:1.0:1785787670.452105:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770023680 00000100:00100000:2.0:1785787670.452327:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770023936 00000100:00100000:2.0:1785787670.452331:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770023936 00000100:00100000:3.0:1785787670.453578:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1785787670.453587:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907712bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3335:x1872533770023808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787670.453638:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907712bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3335:x1872533770023808:12345-0@lo:400:kworker.0 Request processed in 53us (2129us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787670.453646:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1785787670.453682:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bd79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3335:1872533770023424:0@lo:400:kworker.0 00000100:00100000:3.0:1785787670.453693:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919048780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8642023-9103-4dbf-85d1-f204189bc871:3335:1872533770023296:0@lo:400:kworker.0 00000100:00100000:3.0:1785787670.453704:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076ecdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3335:1872533770023808:0@lo:400:kworker.0 00000100:00080000:0.0:1785787670.454002:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785787670.454007:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785787670.454009:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785787670.459615:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1785787670.459647:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770023680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787670.459737:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770023680:12345-0@lo:400:kworker.0 Request processed in 94us (8447us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787670.459745:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1785787670.460909:0:3333:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1785787670.460916:0:3333:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1785787670.460934:0:3333:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91907fe17100, transno 4294967304 00000100:00100000:1.0:1785787670.460949:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770023680:0@lo:400:kworker.0 00000100:00100000:2.0:1785787670.461411:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1785787670.461422:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3335:x1872533770023936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787670.461601:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3335:x1872533770023936:12345-0@lo:400:kworker.0 Request processed in 181us (10010us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787670.461609:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1785787670.461646:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770023936:0@lo:400:kworker.0 00000040:00080000:1.0:1785787670.707093:0:11564:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1785787670.707102:0:11564:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1785787670.707139:0:11564:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1785787670.707146:0:11564:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000004:00080000:0.0:1785787670.963081:0:7825:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 458207251143ns, next at 459207249019ns, rc = 0 00000100:00100000:1.0:1785787670.963381:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770024064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785787670.963541:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787670.963694:0:6621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770024064 00000100:00100000:0.0:1785787670.963702:0:6621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770024064 00000100:00100000:0.0:1785787670.963755:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1785787670.963764:0:6621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3333:x1872533770024064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785787670.963811:0:6621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785787670.963883:0:6621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3333:x1872533770024064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787670.963890:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1785787670.964092:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770024064:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785787671.030335:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1785787671.562230:0:5843:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000001:00080000:0.0:1785787671.562260:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967408 is committed 00000020:00080000:0.0:1785787671.562272:0:5843:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91907bb28000 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1785787671.562276:0:5843:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff919050fbdf00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91907bb28d80 00000020:00080000:0.0:1785787671.562280:0:5843:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff919050fbda00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91907fcda400 00000020:00080000:0.0:1785787671.562295:0:5843:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:0.0:1785787671.562304:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1785787671.562339:0:5854:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000100:00100000:1.0:1785787671.562351:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785787671.562370:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770024192:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1785787671.562431:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1785787671.562478:0:5854:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:1.0:1785787671.562486:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770024192 00000100:00100000:1.0:1785787671.562492:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770024192 00000100:00100000:1.0:1785787671.562542:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1785787671.562560:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905069fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3333:x1872533770024192:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1785787671.562928:0:6619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1785787671.562932:0:6619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1785787665 -> 1785787665 00002000:00010000:1.0:1785787671.562935:0:6619:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 1785787664 -> 1785787664 00002000:00010000:1.0:1785787671.562943:0:6619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1785787665 -> 1785787665 00002000:00010000:1.0:1785787671.562945:0:6619:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1785787671.562986:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905069fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3333:x1872533770024192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 435us (553us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1785787671.562993:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000004:00080000:0.0:1785787671.564483:0:3333:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9190514f4700/2, rc 0, transno 4294967312 00000100:00100000:0.0:1785787671.564491:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770024192:0@lo:2:osp-syn-1-0.0 00000001:00080000:2.0:1785787671.575585:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:2.0:1785787671.575600:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:1.0:1785787672.051745:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787673.011028:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770024320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785787673.011097:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787673.011165:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770024320 00000100:00100000:3.0:1785787673.011194:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770024320 00000100:00080000:0.0:1785787673.011311:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785787673.011823:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1785787673.011862:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ecd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533770024320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785787673.011894:0:6620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785787673.011951:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ecd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533770024320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787673.011958:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1785787673.012038:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770024320:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1785787673.075018:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787674.099042:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787675.122942:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787675.262943:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787675.262976:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787675.262993:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787675.263010:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787675.263029:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787675.263051:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744844288 00000100:00100000:0.0:1785787675.263060:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744844288 00000100:00100000:0.0:1785787675.263101:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744843904 00000100:00100000:0.0:1785787675.263103:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744843904 00000100:00100000:0.0:1785787675.263120:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 171 00000100:00100000:0.0:1785787675.263136:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4ec65b7-e63e-42dc-becf-cba362002085+5:2388:x1872533744844288:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1785787675.263198:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4ec65b7-e63e-42dc-becf-cba362002085+5:2388:x1872533744844288:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 63us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787675.263205:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 171 00000100:00100000:0.0:1785787675.263221:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 172 00000100:00100000:0.0:1785787675.263226:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+13:2388:x1872533744843904:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1785787675.263245:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+13:2388:x1872533744843904:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 20us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787675.263251:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 172 00000100:00080000:0.0:1785787675.263267:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785787675.263437:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744843776 00000100:00100000:2.0:1785787675.263441:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744843776 00000100:00100000:2.0:1785787675.263472:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 305 00000100:00100000:2.0:1785787675.263479:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051505050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2388:x1872533744843776:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:2.0:1785787675.263518:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051505050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2388:x1872533744843776:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 40us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787675.263531:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 305 00000100:00100000:2.0:1785787675.263556:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744844032 00000100:00100000:2.0:1785787675.263559:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744844032 00000100:00100000:2.0:1785787675.263583:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744844160 00000100:00100000:2.0:1785787675.263595:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744844160 00000100:00100000:2.0:1785787675.263614:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 96 00000100:00100000:2.0:1785787675.263619:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:79280304-55c6-4698-bfc3-29d14648ba45+5:2388:x1872533744844032:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:2.0:1785787675.263641:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:79280304-55c6-4698-bfc3-29d14648ba45+5:2388:x1872533744844032:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 21us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787675.263646:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 96 00000100:00100000:2.0:1785787675.263655:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 97 00000100:00100000:2.0:1785787675.263660:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:79280304-55c6-4698-bfc3-29d14648ba45+6:2388:x1872533744844160:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:2.0:1785787675.263677:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:79280304-55c6-4698-bfc3-29d14648ba45+6:2388:x1872533744844160:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 17us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787675.263682:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 97 00000100:00080000:2.0:1785787675.263748:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785787675.263751:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785787675.538675:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787675.538767:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744844416 00000100:00100000:2.0:1785787675.538789:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744844416 00000100:00100000:2.0:1785787675.538863:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 135 00000100:00100000:2.0:1785787675.538872:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+13:10257:x1872533744844416:12345-192.168.203.53@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1785787675.538959:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+13:10257:x1872533744844416:12345-192.168.203.53@tcp:60:lhsmtool_posix.0 Request processed in 88us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787675.538966:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 135 00000100:00100000:2.0:1785787675.542786:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787675.542868:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744844672 00000100:00100000:1.0:1785787675.542877:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744844672 00000100:00100000:1.0:1785787675.542927:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 35 00000100:00100000:1.0:1785787675.542936:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076edf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+13:10257:x1872533744844672:12345-192.168.203.53@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1785787675.544505:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076edf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+14:10257:x1872533744844672:12345-192.168.203.53@tcp:35:lhsmtool_posix.0 Request processed in 1566us (1720us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1785787675.544514:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 35 00000100:00100000:0.0:1785787675.571073:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076edc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1872533770024576:0@lo:400:kworker.0 00000100:00100000:0.0:1785787675.571132:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787675.571186:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bc1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770025088:0@lo:400:kworker.0 00000100:00100000:0.0:1785787675.571209:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787675.571240:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785787675.571246:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bc19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3333:1872533770024704:0@lo:400:kworker.0 00000100:00100000:0.0:1785787675.571266:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787675.571292:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770025088 00000100:00100000:0.0:1785787675.571299:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770025088 00000100:00100000:0.0:1785787675.571401:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1785787675.571410:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3333:x1872533770025088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787675.571483:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bc1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770024832:0@lo:400:kworker.0 00000100:00100000:1.0:1785787675.571510:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787675.571535:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1785787675.571540:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076eded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8642023-9103-4dbf-85d1-f204189bc871:3335:1872533770024448:0@lo:400:kworker.0 00000100:00100000:1.0:1785787675.571562:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787675.571580:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bc18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3335:1872533770024960:0@lo:400:kworker.0 00000100:00100000:1.0:1785787675.571607:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787675.571638:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770024832 00000100:00100000:1.0:1785787675.571641:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770024832 00000100:00100000:1.0:1785787675.571671:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1785787675.571677:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077129c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533770024832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787675.571733:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077129c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533770024832:12345-0@lo:400:kworker.0 Request processed in 56us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787675.571740:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1785787675.571759:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770024448 00000100:00100000:1.0:1785787675.571762:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770024448 00000100:00100000:1.0:1785787675.571781:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1785787675.571787:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051504050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+19:3335:x1872533770024448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787675.571811:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051504050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+19:3335:x1872533770024448:12345-0@lo:400:kworker.0 Request processed in 24us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787675.571816:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1785787675.571870:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076eded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8642023-9103-4dbf-85d1-f204189bc871:3335:1872533770024448:0@lo:400:kworker.0 00000100:00100000:1.0:1785787675.571882:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bc1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770024832:0@lo:400:kworker.0 00000100:00100000:1.0:1785787675.571905:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770024576 00000100:00100000:1.0:1785787675.571908:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770024576 00000100:00100000:1.0:1785787675.571926:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770024704 00000100:00100000:1.0:1785787675.571928:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770024704 00000100:00100000:1.0:1785787675.571937:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770024960 00000100:00100000:1.0:1785787675.571939:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770024960 00000100:00100000:1.0:1785787675.571949:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1785787675.571954:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1872533770024576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787675.571982:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1872533770024576:12345-0@lo:400:kworker.0 Request processed in 27us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787675.571987:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1785787675.571996:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1785787675.572001:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1872533770024704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787675.572020:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1872533770024704:12345-0@lo:400:kworker.0 Request processed in 19us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787675.572030:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1785787675.572039:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1785787675.572044:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3335:x1872533770024960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787675.572068:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3335:x1872533770024960:12345-0@lo:400:kworker.0 Request processed in 24us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787675.572073:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1785787675.572093:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bc18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3335:1872533770024960:0@lo:400:kworker.0 00000100:00100000:1.0:1785787675.572107:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bc19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3333:1872533770024704:0@lo:400:kworker.0 00000100:00100000:1.0:1785787675.572115:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076edc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1872533770024576:0@lo:400:kworker.0 00000100:00100000:0.0:1785787675.572506:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3333:x1872533770025088:12345-0@lo:400:kworker.0 Request processed in 1097us (1295us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787675.572512:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:0.0:1785787675.572543:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785787675.572548:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785787675.572550:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785787675.573381:0:3333:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1785787675.573388:0:3333:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:1.0:1785787675.573405:0:3333:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9190514f4700 x1872533770024192/t4294967312(4294967312) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1785787687 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787675.573492:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bc1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770025088:0@lo:400:kworker.0 00000100:00100000:1.0:1785787675.799361:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787675.799560:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744844800 00000100:00100000:2.0:1785787675.799569:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744844800 00000100:00100000:2.0:1785787675.799634:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 136 00000100:00100000:2.0:1785787675.799642:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4ec65b7-e63e-42dc-becf-cba362002085+5:11065:x1872533744844800:12345-192.168.203.53@tcp:101:lsof.0 00010000:00010000:2.0:1785787675.799659:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787675.799678:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84db5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd4f2 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787675.799737:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84dbc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787675.799750:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84dbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787675.799762:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84dbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787675.799977:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1785787675.799981:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1785787675.800068:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84dbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787675.800089:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84db5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4f2 expref: 7 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787675.800111:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84dbc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4f2 expref: 6 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787675.800118:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9190481f9600) 00010000:00010000:2.0:1785787675.800121:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785787675.800123:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677d200, rc 0) 00000100:00100000:2.0:1785787675.800177:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4ec65b7-e63e-42dc-becf-cba362002085+6:11065:x1872533744844800:12345-192.168.203.53@tcp:101:lsof.0 Request processed in 535us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787675.800182:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 136 00000100:00100000:3.0:1785787676.084341:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785787676.084362:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b48c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770025216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785787676.084426:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787676.085042:0:8140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770025216 00000100:00100000:0.0:1785787676.085050:0:8140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770025216 00000100:00100000:0.0:1785787676.085100:0:8140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1785787676.085108:0:8140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3333:x1872533770025216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785787676.085139:0:8140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785787676.085192:0:8140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3333:x1872533770025216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787676.085199:0:8140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1785787676.085337:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b48c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770025216:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1785787676.147046:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1785787676.663620:0:5843:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:0.0:1785787676.663643:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1785787676.663655:0:5854:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1785787676.663664:0:5854:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:3.0:1785787676.711859:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00010000:00010000:3.0:1785787677.171213:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787678.131056:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785787678.132204:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919048780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770025344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785787678.132270:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787678.134519:0:6621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770025344 00000100:00100000:2.0:1785787678.134531:0:6621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770025344 00000100:00100000:2.0:1785787678.134647:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1785787678.134659:0:6621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770025344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785787678.134693:0:6621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785787678.134757:0:6621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770025344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (2486us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787678.134764:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1785787678.134925:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919048780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770025344:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1785787678.142911:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1785787678.196481:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787679.222482:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787680.250023:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787680.385606:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787680.385681:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744844928 00000100:00100000:1.0:1785787680.385691:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744844928 00000100:00100000:1.0:1785787680.385747:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 307 00000100:00100000:1.0:1785787680.385757:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051507c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2390:x1872533744844928:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1785787680.385859:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051507c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2390:x1872533744844928:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 103us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787680.385867:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 307 00000100:00100000:0.0:1785787680.409622:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787680.409844:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787680.409875:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787680.409897:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787680.409955:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744845312 00000100:00100000:3.0:1785787680.409964:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744845312 00000100:00100000:3.0:1785787680.410011:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744845184 00000100:00100000:3.0:1785787680.410014:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744845184 00000100:00100000:3.0:1785787680.410035:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 100 00000100:00100000:3.0:1785787680.410045:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:79280304-55c6-4698-bfc3-29d14648ba45+6:2391:x1872533744845312:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1785787680.410108:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:79280304-55c6-4698-bfc3-29d14648ba45+6:2391:x1872533744845312:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 66us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787680.410115:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 100 00000100:00100000:3.0:1785787680.410129:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 101 00000100:00100000:3.0:1785787680.410135:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:79280304-55c6-4698-bfc3-29d14648ba45+5:2390:x1872533744845184:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1785787680.410154:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:79280304-55c6-4698-bfc3-29d14648ba45+5:2390:x1872533744845184:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 20us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787680.410160:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 101 00000100:00080000:0.0:1785787680.418531:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785787680.418540:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785787680.424918:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744845056 00000100:00100000:2.0:1785787680.425022:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744845056 00000100:00100000:3.0:1785787680.427971:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744845440 00000100:00100000:3.0:1785787680.427984:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744845440 00000100:00100000:3.0:1785787680.428066:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 176 00000100:00100000:3.0:1785787680.428078:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4ec65b7-e63e-42dc-becf-cba362002085+6:2390:x1872533744845440:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1785787680.428157:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4ec65b7-e63e-42dc-becf-cba362002085+6:2390:x1872533744845440:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 83us (18258us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787680.428165:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 176 00000100:00100000:3.0:1785787680.428213:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 177 00000100:00100000:3.0:1785787680.428219:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+13:2390:x1872533744845056:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1785787680.428245:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+13:2390:x1872533744845056:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 26us (18632us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787680.428251:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 177 00000100:00080000:0.0:1785787680.428306:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785787680.692346:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b48ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8642023-9103-4dbf-85d1-f204189bc871:3336:1872533770025472:0@lo:400:kworker.0 00000100:00100000:1.0:1785787680.692427:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787680.692533:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770025472 00000100:00100000:3.0:1785787680.692541:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770025472 00000100:00100000:3.0:1785787680.692592:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1785787680.692603:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051506c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+19:3336:x1872533770025472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787680.699376:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b48c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3334:1872533770025728:0@lo:400:kworker.0 00000100:00100000:0.0:1785787680.699442:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787680.699504:0:3334:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1785787680.699512:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b48ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533770025600:0@lo:400:kworker.0 00000100:00100000:0.0:1785787680.699536:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787680.699554:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41d9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770026112:0@lo:400:kworker.0 00000100:00100000:0.0:1785787680.699578:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787680.700327:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41d9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770025856:0@lo:400:kworker.0 00000100:00100000:0.0:1785787680.700361:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787680.700426:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785787680.700433:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41d9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3335:1872533770025984:0@lo:400:kworker.0 00000100:00100000:0.0:1785787680.700458:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787680.700494:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770026112 00000100:00100000:0.0:1785787680.700501:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770026112 00000100:00100000:0.0:1785787680.700544:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770025856 00000100:00100000:0.0:1785787680.700547:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770025856 00000100:00100000:0.0:1785787680.700563:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1785787680.700570:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770026112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787680.700617:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770026112:12345-0@lo:400:kworker.0 Request processed in 46us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787680.700623:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1785787680.700639:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1785787680.700645:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41d9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533770025856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787680.700674:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41d9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533770025856:12345-0@lo:400:kworker.0 Request processed in 30us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787680.700680:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:0.0:1785787680.700709:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785787680.700713:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785787680.700740:0:3334:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1785787680.700746:0:3334:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9190514f4700, transno 4294967312 00000100:00100000:0.0:1785787680.700758:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41d9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770026112:0@lo:400:kworker.0 00000100:00100000:0.0:1785787680.700786:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41d9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770025856:0@lo:400:kworker.0 00000100:00100000:3.0:1785787680.702561:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051506c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+19:3336:x1872533770025472:12345-0@lo:400:kworker.0 Request processed in 9956us (10130us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787680.702572:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1785787680.702601:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770025728 00000100:00100000:3.0:1785787680.702606:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770025728 00000100:00100000:3.0:1785787680.702641:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770025600 00000100:00100000:3.0:1785787680.702644:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770025600 00000100:00100000:3.0:1785787680.702655:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770025984 00000100:00100000:3.0:1785787680.702657:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770025984 00000100:00100000:3.0:1785787680.702671:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1785787680.702677:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41d9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3334:x1872533770025728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787680.702730:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41d9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3334:x1872533770025728:12345-0@lo:400:kworker.0 Request processed in 53us (3288us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787680.702737:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1785787680.702749:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1785787680.702755:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533770025600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787680.702781:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533770025600:12345-0@lo:400:kworker.0 Request processed in 26us (3244us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787680.702786:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1785787680.702795:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1785787680.702801:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3335:x1872533770025984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787680.702841:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3335:x1872533770025984:12345-0@lo:400:kworker.0 Request processed in 27us (2369us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787680.702847:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:3.0:1785787680.702929:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785787680.702957:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b48ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533770025600:0@lo:400:kworker.0 00000100:00100000:3.0:1785787680.702969:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b48c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3334:1872533770025728:0@lo:400:kworker.0 00000100:00100000:3.0:1785787680.702997:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41d9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3335:1872533770025984:0@lo:400:kworker.0 00000001:02000400:2.0:1785787680.709046:0:12241:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 16:07:59 (1785787679) 00000100:00100000:1.0:1785787680.709499:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b48ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8642023-9103-4dbf-85d1-f204189bc871:3336:1872533770025472:0@lo:400:kworker.0 00000040:00080000:2.0:1785787680.947684:0:11564:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1785787680.947691:0:11564:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1785787680.948118:0:11564:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1785787680.948125:0:11564:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1785787681.205856:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785787681.205883:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41d9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770026240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785787681.205946:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787681.206255:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770026240 00000100:00100000:0.0:1785787681.206264:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770026240 00000100:00100000:0.0:1785787681.206316:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1785787681.206326:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770026240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785787681.206367:0:6620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785787681.206417:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770026240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787681.206424:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1785787681.206674:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41d9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770026240:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1785787681.267045:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787682.291960:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787682.621533:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787682.622205:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744845696 00000100:00100000:3.0:1785787682.622222:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744845696 00000100:00100000:3.0:1785787682.622297:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 137 00000100:00100000:3.0:1785787682.622309:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41d9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+13:11330:x1872533744845696:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785787682.622330:0:9295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787682.622360:0:9295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84dc3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd4f9 expref: -99 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787682.622450:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e84dca lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787682.622463:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e84dca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787682.622483:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e84dca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787682.622498:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84dd1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787682.622505:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84dd1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787682.622512:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84dd1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787682.622974:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e84dd8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787682.622983:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e84dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787682.622989:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e84dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785787682.622997:0:9295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1785787682.623265:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e84dca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787682.623272:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e84dca lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787682.623284:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e84dca lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787682.623291:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903200 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787682.623295:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e84dca lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787682.623302:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e84dca lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787682.623315:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91905685f200) 00010000:00010000:3.0:1785787682.623318:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787682.623322:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e84dca lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787682.623329:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e84dca lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787682.623341:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84dd1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787682.623348:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84dd1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787682.623353:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84dd1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787682.623358:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f902600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787682.623361:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84dd1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787682.623377:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84dd1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787682.623385:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff919055acd600) 00010000:00010000:3.0:1785787682.623387:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787682.623390:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84dd1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787682.623396:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84dd1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787682.623739:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84dc3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4f9 expref: 16 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787682.623753:0:9295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e84dd8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4f9 expref: 15 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787682.623759:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9190481f9400) 00010000:00010000:3.0:1785787682.623761:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787682.623763:0:9295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f903a00, rc 0) 00000100:00100000:3.0:1785787682.623858:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41d9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+15:11330:x1872533744845696:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 1523us (2303us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1785787682.623866:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 137 00000100:00080000:0.0:1785787682.624029:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785787682.637447:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787682.637504:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787682.637764:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744845824 00000100:00100000:3.0:1785787682.637773:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744845824 00000100:00100000:3.0:1785787682.637851:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 138 00000100:00100000:3.0:1785787682.637860:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+15:11330:x1872533744845824:12345-192.168.203.53@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1785787682.637965:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+15:11330:x1872533744845824:12345-192.168.203.53@tcp:59:lhsmtool_posix.0 Request processed in 105us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787682.637972:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 138 00000100:00100000:2.0:1785787682.638433:0:11051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744845952 00000100:00100000:2.0:1785787682.638443:0:11051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744845952 00000100:00100000:2.0:1785787682.638491:0:11051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 11 00000100:00100000:2.0:1785787682.638498:0:11051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79280304-55c6-4698-bfc3-29d14648ba45+15:2388:x1872533744845952:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785787682.638509:0:11051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785787682.638531:0:11051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e84dd8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4f9 expref: 15 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787682.638548:0:11051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9190481f9400) 00010000:00010000:2.0:1785787682.638553:0:11051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785787682.638587:0:11051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79280304-55c6-4698-bfc3-29d14648ba45+14:2388:x1872533744845952:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 89us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787682.638594:0:11051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 11 00000040:00080000:0.0:1785787682.998631:0:11564:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1785787682.998640:0:11564:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1785787683.003192:0:11564:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1785787683.003418:0:11564:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1785787683.252430:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785787683.252452:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919048780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770026368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785787683.252522:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787683.252667:0:8140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770026368 00000100:00100000:3.0:1785787683.252673:0:8140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770026368 00000100:00100000:3.0:1785787683.252728:0:8140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1785787683.252737:0:8140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770026368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785787683.252770:0:8140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785787683.252811:0:8140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770026368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787683.252817:0:8140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1785787683.252865:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919048780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770026368:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1785787683.252951:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1785787683.316059:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787684.339086:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785787685.268340:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787685.268486:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744846080 00000100:00100000:0.0:1785787685.268495:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744846080 00000100:00100000:0.0:1785787685.268560:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 139 00000100:00100000:0.0:1785787685.268570:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bc1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+14:11372:x1872533744846080:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:0.0:1785787685.268589:0:9295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787685.268610:0:9295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919050678c00/0xe2c2ff68a6e84de6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd500 expref: -99 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.268679:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919050678a00/0xe2c2ff68a6e84ded lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.268692:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919050678a00/0xe2c2ff68a6e84ded lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.268705:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919050678a00/0xe2c2ff68a6e84ded lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.268718:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919050679200/0xe2c2ff68a6e84df4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.268725:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919050679200/0xe2c2ff68a6e84df4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.268731:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919050679200/0xe2c2ff68a6e84df4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.268988:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919050678a00/0xe2c2ff68a6e84ded lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.268996:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919050678a00/0xe2c2ff68a6e84ded lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.269003:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919050678a00/0xe2c2ff68a6e84ded lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.269009:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919050678a00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1785787685.269013:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919050678a00/0xe2c2ff68a6e84ded lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.269029:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919050678a00/0xe2c2ff68a6e84ded lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.269041:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9190481f9600) 00010000:00010000:0.0:1785787685.269044:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785787685.269049:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919050678a00/0xe2c2ff68a6e84ded lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.269055:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919050678a00/0xe2c2ff68a6e84ded lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.269066:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919050679200/0xe2c2ff68a6e84df4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.269071:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919050679200/0xe2c2ff68a6e84df4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.269077:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919050679200/0xe2c2ff68a6e84df4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.269081:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919050679200 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1785787685.269083:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919050679200/0xe2c2ff68a6e84df4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.269089:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919050679200/0xe2c2ff68a6e84df4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.269095:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff919059e3ed00) 00010000:00010000:0.0:1785787685.269097:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785787685.269099:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919050679200/0xe2c2ff68a6e84df4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.269112:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919050679200/0xe2c2ff68a6e84df4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.269140:0:9295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919050678c00/0xe2c2ff68a6e84de6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd500 expref: 15 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.269150:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9190481f9600) 00010000:00010000:0.0:1785787685.269152:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785787685.269156:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919050678c00/0xe2c2ff68a6e84de6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd500 expref: 15 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.269164:0:9295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919050678c00, rc 0) 00000100:00100000:0.0:1785787685.269229:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bc1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+14:11372:x1872533744846080:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 660us (907us total) trans 0 rc 301/301 00000100:00100000:0.0:1785787685.269236:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 139 00000100:00080000:2.0:1785787685.269642:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785787685.297949:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787685.298981:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744846336 00000100:00100000:2.0:1785787685.298991:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744846336 00000100:00100000:2.0:1785787685.299047:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 140 00000100:00100000:2.0:1785787685.299056:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+14:11372:x1872533744846336:12345-192.168.203.53@tcp:36:lfs.0 00010000:00010000:2.0:1785787685.299106:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785787685.299130:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e84764 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd339 expref: 14 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787685.299145:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9190481f9600) 00010000:00010000:2.0:1785787685.299150:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785787685.299590:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84dfb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787685.299605:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84dbc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4f2 expref: 5 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787685.299620:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84dfb lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787685.299652:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84dbc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4f2 expref: 5 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787685.299666:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84dbc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4f2 expref: 5 pid: 5822 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787685.299679:0:5821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bc19f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5821:1872533770026496:192.168.203.53@tcp:104: 00000100:00100000:2.0:1785787685.299769:0:5821:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190507db3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785787685.302779:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787685.302810:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744846464 00000100:00100000:3.0:1785787685.302818:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744846464 00010000:00010000:3.0:1785787685.302885:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84dbc lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4f2 expref: 6 pid: 5822 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787685.302919:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 59 00000100:00100000:3.0:1785787685.302927:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4ec65b7-e63e-42dc-becf-cba362002085+6:2390:x1872533744846464:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785787685.302941:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787685.302948:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84dbc lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4f2 expref: 6 pid: 5822 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787685.302975:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84dbc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4f2 expref: 6 pid: 5822 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787685.302996:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9190481f9600) 00010000:00010000:3.0:1785787685.303001:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84dfb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787685.303010:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84dfb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787685.303018:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84dfb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787685.303033:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787685.303074:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4ec65b7-e63e-42dc-becf-cba362002085+6:2390:x1872533744846464:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 147us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787685.303081:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 59 00000100:00080000:2.0:1785787685.303469:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1785787685.303501:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84dbc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4f2 expref: 5 pid: 5822 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787685.303516:0:5821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bc19f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5821:1872533770026496:192.168.203.53@tcp:104: 00010000:00010000:2.0:1785787685.303532:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84dfb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787685.303541:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84dfb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787685.303547:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84dfb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787685.303566:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84e02 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787685.303596:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84e02 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787685.303604:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84e02 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787685.308947:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1785787685.308965:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84dfb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787685.308975:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84dfb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787685.308982:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84dfb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787685.308989:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677ca00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787685.308993:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84dfb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787685.309000:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84dfb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787685.309014:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9190481f9600) 00010000:00010000:2.0:1785787685.309018:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787685.309023:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84dfb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787685.309030:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84dfb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785787685.309059:0:5821:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009bdf1f6a reply state 000000001e601f43 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84e02 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787685.309068:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785787685.309151:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+15:11372:x1872533744846336:12345-192.168.203.53@tcp:36:lfs.0 Request processed in 10093us (11208us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1785787685.309159:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 140 00010000:00010000:0.0:1785787685.316369:0:3319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84e02 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.318763:0:3319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84e02 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.318781:0:3319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84e02 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.318789:0:3319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677cc00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1785787685.318794:0:3319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84e02 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.318803:0:3319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84e02 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.318845:0:3319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9190481f9100) 00010000:00010000:0.0:1785787685.318849:0:3319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785787685.318854:0:3319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84e02 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.318861:0:3319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84e02 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.363404:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787685.420624:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787685.422649:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744846592 00000100:00100000:0.0:1785787685.422660:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744846592 00000100:00100000:2.0:1785787685.423553:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 141 00000100:00100000:2.0:1785787685.423565:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+14:11380:x1872533744846592:12345-192.168.203.53@tcp:101:lctl.0 00010000:00010000:2.0:1785787685.423596:0:9295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787685.423618:0:9295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84e09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd507 expref: -99 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787685.423677:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84e10 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787685.423690:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84e10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787685.423701:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84e10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787685.423757:0:9295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1785787685.423761:0:9295:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1785787685.423783:0:9295:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84e10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787685.423807:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84e09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd507 expref: 16 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787685.423870:0:9295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84e10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd507 expref: 15 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787685.423879:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9190481f9b00) 00010000:00010000:2.0:1785787685.423882:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785787685.423885:0:9295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677d200, rc 0) 00000100:00100000:2.0:1785787685.423948:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+15:11380:x1872533744846592:12345-192.168.203.53@tcp:101:lctl.0 Request processed in 385us (3566us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787685.423955:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 141 00000100:00100000:3.0:1785787685.484525:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787685.484626:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744846720 00000100:00100000:0.0:1785787685.484636:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744846720 00000100:00100000:0.0:1785787685.484697:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 142 00000100:00100000:0.0:1785787685.484707:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+15:11386:x1872533744846720:12345-192.168.203.53@tcp:101:bash.0 00010000:00010000:0.0:1785787685.484726:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787685.484746:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919050678c00/0xe2c2ff68a6e84e17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd50e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.484801:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919050679200/0xe2c2ff68a6e84e1e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.484814:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919050679200/0xe2c2ff68a6e84e1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.484824:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919050679200/0xe2c2ff68a6e84e1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.484868:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919050678a00/0xe2c2ff68a6e84e25 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.484888:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919050678a00/0xe2c2ff68a6e84e25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.484895:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919050678a00/0xe2c2ff68a6e84e25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.484993:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919050678000/0xe2c2ff68a6e84e2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.485002:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919050678000/0xe2c2ff68a6e84e2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.485009:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919050678000/0xe2c2ff68a6e84e2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785787685.485036:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1785787685.485040:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1785787685.485059:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919050678000/0xe2c2ff68a6e84e2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.485071:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919050679200/0xe2c2ff68a6e84e1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.485078:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919050679200/0xe2c2ff68a6e84e1e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.485085:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919050679200/0xe2c2ff68a6e84e1e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.485091:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919050679200 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1785787685.485096:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919050679200/0xe2c2ff68a6e84e1e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.485109:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919050679200/0xe2c2ff68a6e84e1e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.485120:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9190481f9b00) 00010000:00010000:0.0:1785787685.485123:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785787685.485127:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919050679200/0xe2c2ff68a6e84e1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.485134:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919050679200/0xe2c2ff68a6e84e1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.485146:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919050678a00/0xe2c2ff68a6e84e25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.485153:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919050678a00/0xe2c2ff68a6e84e25 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.485159:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919050678a00/0xe2c2ff68a6e84e25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.485165:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919050678a00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1785787685.485167:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919050678a00/0xe2c2ff68a6e84e25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.485173:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919050678a00/0xe2c2ff68a6e84e25 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.485180:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff919059e3ed00) 00010000:00010000:0.0:1785787685.485182:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785787685.485185:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919050678a00/0xe2c2ff68a6e84e25 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.485200:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919050678a00/0xe2c2ff68a6e84e25 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.485227:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919050678c00/0xe2c2ff68a6e84e17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd50e expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.485711:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919050678000/0xe2c2ff68a6e84e2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd50e expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.485719:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff919059e3e900) 00010000:00010000:0.0:1785787685.485722:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1785787685.485724:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919050678000, rc 0) 00000100:00100000:0.0:1785787685.485783:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+16:11386:x1872533744846720:12345-192.168.203.53@tcp:101:bash.0 Request processed in 1077us (1265us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787685.485790:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 142 00000100:00100000:3.0:1785787685.488448:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787685.488555:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744846976 00000100:00100000:0.0:1785787685.488563:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744846976 00000100:00100000:0.0:1785787685.488651:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 143 00000100:00100000:0.0:1785787685.488661:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+16:11386:x1872533744846976:12345-192.168.203.53@tcp:101:bash.0 00010000:00010000:0.0:1785787685.488678:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787685.488693:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919050678600/0xe2c2ff68a6e84e33 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd515 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.488796:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919050678800/0xe2c2ff68a6e84e3a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.488809:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919050678800/0xe2c2ff68a6e84e3a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.488857:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919050678800/0xe2c2ff68a6e84e3a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.488903:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919050679600/0xe2c2ff68a6e84e41 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.488912:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919050679600/0xe2c2ff68a6e84e41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.488919:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919050679600/0xe2c2ff68a6e84e41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785787685.489438:0:5820:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1785787685.489597:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fe00/0xe2c2ff68a6e84e48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.489606:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fe00/0xe2c2ff68a6e84e48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.489614:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fe00/0xe2c2ff68a6e84e48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.489647:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919050678800/0xe2c2ff68a6e84e3a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.489655:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919050678800/0xe2c2ff68a6e84e3a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.489661:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919050678800/0xe2c2ff68a6e84e3a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.489667:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919050678800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1785787685.489676:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919050678800/0xe2c2ff68a6e84e3a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.489684:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919050678800/0xe2c2ff68a6e84e3a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.489694:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff919059e3e900) 00010000:00010000:0.0:1785787685.489697:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785787685.489700:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919050678800/0xe2c2ff68a6e84e3a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.489706:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919050678800/0xe2c2ff68a6e84e3a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785787685.489718:0:5820:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004760b5ce reply state 000000001839f00b transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff919050679600/0xe2c2ff68a6e84e41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787685.489739:0:5820:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785787685.489763:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919050678600/0xe2c2ff68a6e84e33 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd515 expref: 19 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.489776:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fe00/0xe2c2ff68a6e84e48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd515 expref: 18 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.489784:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff919059e3e800) 00010000:00010000:0.0:1785787685.489787:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785787685.489789:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919052f5fe00, rc 0) 00000100:00100000:0.0:1785787685.489858:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+19:11386:x1872533744846976:12345-192.168.203.53@tcp:101:bash.0 Request processed in 1198us (1468us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1785787685.489865:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 143 00010000:00010000:1.0:1785787685.493203:0:3320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919050679600/0xe2c2ff68a6e84e41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787685.493219:0:3320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919050679600/0xe2c2ff68a6e84e41 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787685.493226:0:3320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919050679600/0xe2c2ff68a6e84e41 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787685.493253:0:3320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919050679600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787685.493257:0:3320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919050679600/0xe2c2ff68a6e84e41 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787685.493265:0:3320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919050679600/0xe2c2ff68a6e84e41 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787685.493277:0:3320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff919059e3e300) 00010000:00010000:1.0:1785787685.493280:0:3320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785787685.493284:0:3320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919050679600/0xe2c2ff68a6e84e41 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787685.493290:0:3320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919050679600/0xe2c2ff68a6e84e41 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787685.499882:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787685.499956:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744847104 00000100:00100000:0.0:1785787685.499964:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744847104 00000100:00100000:0.0:1785787685.500036:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 47 00000100:00100000:0.0:1785787685.500045:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bc19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+5:2391:x1872533744847104:12345-192.168.203.53@tcp:101:bash.0 00010000:00010000:0.0:1785787685.500062:0:6618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787685.500083:0:6618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000095dbba8/0xe2c2ff68a6e84e56 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd51c expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785787685.500108:0:6618:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1785787685.500126:0:6618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=472s v=(0 0) 00010000:00010000:0.0:1785787685.500131:0:6618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785787685.500139:0:6618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000095dbba8/0xe2c2ff68a6e84e56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd51c expref: 6 pid: 6618 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.500156:0:6618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000095dbba8/0xe2c2ff68a6e84e56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd51c expref: 6 pid: 6618 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.500168:0:6618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919052f5e000, rc 0) 00000100:00100000:0.0:1785787685.500216:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bc19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+6:2391:x1872533744847104:12345-192.168.203.53@tcp:101:bash.0 Request processed in 173us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787685.500228:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 47 00000100:00080000:2.0:1785787685.500326:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785787685.503193:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787685.503228:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787685.503302:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787685.503330:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744847360 00000100:00100000:3.0:1785787685.503337:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744847360 00000100:00100000:3.0:1785787685.503383:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744847488 00000100:00100000:2.0:1785787685.503490:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 104 00000100:00100000:2.0:1785787685.503502:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:79280304-55c6-4698-bfc3-29d14648ba45+6:2391:x1872533744847360:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:2.0:1785787685.503562:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:79280304-55c6-4698-bfc3-29d14648ba45+6:2391:x1872533744847360:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 63us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787685.503570:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 104 00000100:00100000:0.0:1785787685.503732:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744847232 00000100:00100000:0.0:1785787685.503737:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744847232 00000100:00100000:0.0:1785787685.503774:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 309 00000100:00100000:0.0:1785787685.503781:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051505850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2391:x1872533744847232:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1785787685.503816:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051505850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2391:x1872533744847232:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 35us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787685.503853:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 309 00000100:00100000:3.0:1785787685.503953:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744847488 00000100:00100000:3.0:1785787685.504464:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 48 00000100:00100000:3.0:1785787685.504479:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ec9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:79280304-55c6-4698-bfc3-29d14648ba45+6:11386:x1872533744847488:12345-192.168.203.53@tcp:101:bash.0 00010000:00010000:3.0:1785787685.504491:0:6619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787685.504507:0:6619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c693aad9/0xe2c2ff68a6e84e5d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd523 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787685.504532:0:6619:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000095dbba8/0xe2c2ff68a6e84e56 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd51c expref: 7 pid: 6618 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787685.504540:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785787685.504544:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785787685.504549:0:6619:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c693aad9/0xe2c2ff68a6e84e5d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd523 expref: 7 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787685.504579:0:6619:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000095dbba8/0xe2c2ff68a6e84e56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd51c expref: 7 pid: 6618 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787685.504592:0:6619:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000095dbba8/0xe2c2ff68a6e84e56 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd51c expref: 7 pid: 6618 timeout: 572 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787685.504604:0:6619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b377800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6619:1872533770026624:192.168.203.53@tcp:104: 00000100:00100000:3.0:1785787685.504673:0:6619:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190809c7b40 going to sleep for 11 seconds 00000100:00080000:3.0:1785787685.504688:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785787685.514927:0:6619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b377800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6619:1872533770026624:192.168.203.53@tcp:104: 00010000:00010000:3.0:1785787685.514961:0:6619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c693aad9/0xe2c2ff68a6e84e5d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd523 expref: 7 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787685.515000:0:6619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f902600, rc 0) 00000100:00100000:3.0:1785787685.515055:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ec9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:79280304-55c6-4698-bfc3-29d14648ba45+7:11386:x1872533744847488:12345-192.168.203.53@tcp:101:bash.0 Request processed in 10577us (11752us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787685.515063:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 48 00000100:00100000:2.0:1785787685.519170:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787685.519253:0:11051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744847616 00000100:00100000:3.0:1785787685.519262:0:11051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744847616 00010000:00010000:3.0:1785787685.519298:0:11051:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000095dbba8/0xe2c2ff68a6e84e56 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd51c expref: 7 pid: 6618 timeout: 572 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787685.519339:0:11051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 60 00000100:00100000:3.0:1785787685.519349:0:11051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bc18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79280304-55c6-4698-bfc3-29d14648ba45+7:2391:x1872533744847616:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785787685.519363:0:11051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787685.519515:0:11051:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000095dbba8/0xe2c2ff68a6e84e56 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd51c expref: 7 pid: 6618 timeout: 572 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787685.519531:0:11051:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000095dbba8/0xe2c2ff68a6e84e56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd51c expref: 7 pid: 6618 timeout: 572 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787685.519552:0:11051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000095dbba8/0xe2c2ff68a6e84e56 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd51c expref: 7 pid: 6618 timeout: 572 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787685.519569:0:11051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785787685.519573:0:11051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785787685.519580:0:11051:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c693aad9/0xe2c2ff68a6e84e5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd523 expref: 6 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787685.519603:0:11051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c693aad9/0xe2c2ff68a6e84e5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd523 expref: 6 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787685.519640:0:11051:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c693aad9/0xe2c2ff68a6e84e5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd523 expref: 6 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787685.519654:0:11051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b377800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11051:1872533770026752:192.168.203.53@tcp:105: 00000100:00100000:3.0:1785787685.519729:0:11051:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190809c7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1785787685.521976:0:11051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b377800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11051:1872533770026752:192.168.203.53@tcp:105: 00010000:00010000:3.0:1785787685.521996:0:11051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787685.522038:0:11051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bc18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79280304-55c6-4698-bfc3-29d14648ba45+6:2391:x1872533744847616:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 2690us (2876us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787685.522049:0:11051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 60 00000100:00100000:0.0:1785787685.524145:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787685.524203:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744847872 00000100:00100000:1.0:1785787685.524211:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744847872 00000100:00100000:1.0:1785787685.524272:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 36 00000100:00100000:1.0:1785787685.524281:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+18:11386:x1872533744847872:12345-192.168.203.53@tcp:35:bash.0 00000100:00100000:1.0:1785787685.524673:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+19:11386:x1872533744847872:12345-192.168.203.53@tcp:35:bash.0 Request processed in 392us (533us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1785787685.524681:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 36 00000100:00100000:2.0:1785787685.652759:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787685.652875:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744848128 00000100:00100000:3.0:1785787685.652884:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744848128 00000100:00100000:3.0:1785787685.652931:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 144 00000100:00100000:3.0:1785787685.652939:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bc19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+19:11396:x1872533744848128:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:3.0:1785787685.652964:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787685.652982:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84e64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd52a expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785787685.653092:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1785787685.653203:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84e64 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd52a expref: 21 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787685.653234:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9190481f9b00) 00010000:00010000:3.0:1785787685.653238:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785787685.653243:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84e64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd52a expref: 21 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787685.653257:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f903e00, rc 0) 00000100:00100000:3.0:1785787685.653313:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bc19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+20:11396:x1872533744848128:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 375us (561us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1785787685.653327:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 144 00000100:00100000:3.0:1785787685.655887:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787685.655961:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744848384 00000100:00100000:1.0:1785787685.655969:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744848384 00000100:00100000:1.0:1785787685.656016:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 37 00000100:00100000:1.0:1785787685.656025:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+20:11396:x1872533744848384:12345-192.168.203.53@tcp:35:lfs.0 00000100:00100000:1.0:1785787685.656216:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+21:11396:x1872533744848384:12345-192.168.203.53@tcp:35:lfs.0 Request processed in 191us (335us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1785787685.656234:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 37 00000100:00100000:0.0:1785787685.786939:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787685.787558:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744848512 00000100:00100000:2.0:1785787685.787568:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744848512 00000100:00100000:2.0:1785787685.787681:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 145 00000100:00100000:2.0:1785787685.787691:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+21:11402:x1872533744848512:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:2.0:1785787685.787713:0:9295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787685.787733:0:9295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84e72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd531 expref: -99 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787685.787810:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84e79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787685.787824:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84e79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787685.788005:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84e79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787685.788060:0:9295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1785787685.788064:0:9295:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1785787685.788083:0:9295:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84e79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787685.788107:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84e72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd531 expref: 23 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787685.788123:0:9295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84e79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd531 expref: 22 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787685.788131:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff919059e3e900) 00010000:00010000:2.0:1785787685.788134:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785787685.788137:0:9295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677da00, rc 0) 00000100:00100000:2.0:1785787685.788232:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+22:11402:x1872533744848512:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 542us (1302us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787685.788240:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 145 00000100:00100000:3.0:1785787685.801919:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787685.802007:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744848768 00000100:00100000:0.0:1785787685.802016:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744848768 00000100:00100000:0.0:1785787685.802071:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 146 00000100:00100000:0.0:1785787685.802080:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+22:11402:x1872533744848768:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:0.0:1785787685.802099:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787685.802118:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ec00/0xe2c2ff68a6e84e80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd538 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.802206:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fa00/0xe2c2ff68a6e84e87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.802220:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fa00/0xe2c2ff68a6e84e87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.802232:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fa00/0xe2c2ff68a6e84e87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785787685.802244:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1785787685.802363:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ec00/0xe2c2ff68a6e84e80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd538 expref: 25 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.802381:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fa00/0xe2c2ff68a6e84e87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd538 expref: 24 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.802390:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff919059e3e800) 00010000:00010000:0.0:1785787685.802405:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785787685.802410:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919052f5fa00, rc 0) 00000100:00100000:0.0:1785787685.802478:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+24:11402:x1872533744848768:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 398us (566us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1785787685.802485:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 146 00000100:00100000:3.0:1785787685.805954:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787685.805988:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787685.806109:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744848896 00000100:00100000:0.0:1785787685.806117:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744848896 00000100:00100000:0.0:1785787685.806167:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 12 00000100:00100000:0.0:1785787685.806176:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79280304-55c6-4698-bfc3-29d14648ba45+24:2388:x1872533744848896:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785787685.806189:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785787685.806210:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fa00/0xe2c2ff68a6e84e87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd538 expref: 24 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.806225:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff919059e3e800) 00010000:00010000:0.0:1785787685.806229:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785787685.806269:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79280304-55c6-4698-bfc3-29d14648ba45+23:2388:x1872533744848896:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 93us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787685.806277:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 12 00000100:00100000:0.0:1785787685.810984:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41d9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3334:1872533770027136:0@lo:400:kworker.0 00000100:00100000:0.0:1785787685.811042:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787685.811095:0:3334:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1785787685.811100:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533770027008:0@lo:400:kworker.0 00000100:00100000:0.0:1785787685.811119:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787685.811133:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41d9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770027520:0@lo:400:kworker.0 00000100:00100000:0.0:1785787685.811152:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787685.811183:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770027520 00000100:00100000:0.0:1785787685.811202:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770027520 00000100:00100000:0.0:1785787685.811254:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1785787685.811261:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41d9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770027520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787685.811309:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41d9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770027520:12345-0@lo:400:kworker.0 Request processed in 48us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787685.811327:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:0.0:1785787685.811346:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785787685.811375:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41d9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770027520:0@lo:400:kworker.0 00000100:00100000:0.0:1785787685.811398:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744849152 00000100:00100000:0.0:1785787685.811402:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744849152 00000100:00100000:0.0:1785787685.811426:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770027136 00000100:00100000:0.0:1785787685.811429:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770027136 00000100:00100000:0.0:1785787685.811447:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770027008 00000100:00100000:0.0:1785787685.811458:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770027008 00000100:00100000:0.0:1785787685.811472:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1785787685.811477:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41d9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3334:x1872533770027136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787685.811511:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41d9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3334:x1872533770027136:12345-0@lo:400:kworker.0 Request processed in 33us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787685.811517:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1785787685.811528:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1785787685.811533:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41d9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533770027008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787685.811555:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41d9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533770027008:12345-0@lo:400:kworker.0 Request processed in 22us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787685.811560:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1785787685.811571:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 147 00000100:00100000:0.0:1785787685.811576:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+23:11402:x1872533744849152:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:0.0:1785787685.811590:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787685.811626:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e600/0xe2c2ff68a6e84e95 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd53f expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.811704:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e84e9c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.811718:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e84e9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.811730:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e84e9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785787685.811741:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1785787685.811876:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e600/0xe2c2ff68a6e84e95 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd53f expref: 26 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.811892:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e84e9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd53f expref: 25 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.811900:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff919059e3e800) 00010000:00010000:0.0:1785787685.811903:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1785787685.811906:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919052f5f200, rc 0) 00000100:00100000:0.0:1785787685.811942:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+25:11402:x1872533744849152:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 365us (5954us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1785787685.811948:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 147 00000100:00080000:0.0:1785787685.811962:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785787685.811978:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533770027008:0@lo:400:kworker.0 00000100:00100000:0.0:1785787685.811986:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41d9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3334:1872533770027136:0@lo:400:kworker.0 00000100:00100000:3.0:1785787685.812357:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41d9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8642023-9103-4dbf-85d1-f204189bc871:3336:1872533770026880:0@lo:400:kworker.0 00000100:00100000:3.0:1785787685.812391:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787685.812421:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41d9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3336:1872533770027392:0@lo:400:kworker.0 00000100:00100000:3.0:1785787685.812443:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787685.812471:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785787685.812477:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770027264:0@lo:400:kworker.0 00000100:00100000:3.0:1785787685.812497:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787685.812522:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770027264 00000100:00100000:3.0:1785787685.812526:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770027264 00000100:00100000:3.0:1785787685.812561:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1785787685.812568:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770027264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787685.812616:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770027264:12345-0@lo:400:kworker.0 Request processed in 48us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787685.812629:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:3.0:1785787685.812645:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785787685.812663:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770027264:0@lo:400:kworker.0 00000100:00100000:3.0:1785787685.812682:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770027392 00000100:00100000:3.0:1785787685.812685:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770027392 00000100:00100000:3.0:1785787685.812711:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1785787685.812718:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3336:x1872533770027392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787685.812751:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3336:x1872533770027392:12345-0@lo:400:kworker.0 Request processed in 33us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787685.812756:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00080000:3.0:1785787685.812769:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785787685.812785:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41d9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3336:1872533770027392:0@lo:400:kworker.0 00000100:00100000:0.0:1785787685.812980:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770026880 00000100:00100000:0.0:1785787685.812990:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770026880 00000100:00100000:0.0:1785787685.813014:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1785787685.813020:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051506450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+19:3336:x1872533770026880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787685.813054:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051506450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+19:3336:x1872533770026880:12345-0@lo:400:kworker.0 Request processed in 35us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787685.813060:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1785787685.813090:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41d9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8642023-9103-4dbf-85d1-f204189bc871:3336:1872533770026880:0@lo:400:kworker.0 00000100:00100000:3.0:1785787685.815908:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787685.815980:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744849280 00000100:00100000:0.0:1785787685.815988:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744849280 00000100:00100000:0.0:1785787685.816025:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 49 00000100:00100000:0.0:1785787685.816033:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:79280304-55c6-4698-bfc3-29d14648ba45+6:2390:x1872533744849280:12345-192.168.203.53@tcp:1:lfs.0 00010000:00010000:0.0:1785787685.816065:0:6617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4bc86fe/0xe2c2ff68a6e84eaa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.816082:0:6617:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c693aad9/0xe2c2ff68a6e84e5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd523 expref: 6 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.816090:0:6617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1785787685.816094:0:6617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1785787685.816098:0:6617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4bc86fe/0xe2c2ff68a6e84eaa lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.816126:0:6617:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c693aad9/0xe2c2ff68a6e84e5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd523 expref: 6 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.816139:0:6617:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c693aad9/0xe2c2ff68a6e84e5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd523 expref: 6 pid: 6619 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787685.816158:0:6617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41d9ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6617:1872533770027648:192.168.203.53@tcp:104: 00000100:00100000:0.0:1785787685.816227:0:6617:0:(client.c:2702:ptlrpc_set_wait()) set ffff919044efac00 going to sleep for 11 seconds 00000100:00100000:2.0:1785787685.818067:0:6617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41d9ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6617:1872533770027648:192.168.203.53@tcp:104: 00010000:00010000:2.0:1785787685.818089:0:6617:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e4bc86fe/0xe2c2ff68a6e84eaa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787685.819402:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787685.819475:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744849408 00000100:00100000:0.0:1785787685.819482:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744849408 00002000:00100000:0.0:1785787685.819522:0:6622:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff91907be0e300 x1872533744849408/t0(0) o4->79280304-55c6-4698-bfc3-29d14648ba45@192.168.203.53@tcp:541/0 lens 504/0 e 0 to 0 dl 1785787696 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785787685.819532:0:6622:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91907be0e300 with x1872533744849408 ext(0->12) 00010000:00010000:0.0:1785787685.819539:0:6622:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c693aad9/0xe2c2ff68a6e84e5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd523 expref: 7 pid: 6619 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.819552:0:6622:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c693aad9/0xe2c2ff68a6e84e5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd523 expref: 7 pid: 6619 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785787685.819560:0:6622:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff91907be0e300 00000100:00100000:0.0:1785787685.819584:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2 00000100:00100000:0.0:1785787685.819593:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:79280304-55c6-4698-bfc3-29d14648ba45+7:2391:x1872533744849408:12345-192.168.203.53@tcp:4:lfs.0 00000100:00100000:0.0:1785787685.820182:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:79280304-55c6-4698-bfc3-29d14648ba45+9:2391:x1872533744849408:12345-192.168.203.53@tcp:4:lfs.0 Request processed in 588us (780us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1785787685.820190:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2 00002000:00100000:0.0:1785787685.820197:0:6622:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff91907be0e300 x1872533744849408/t4294967305(0) o4->79280304-55c6-4698-bfc3-29d14648ba45@192.168.203.53@tcp:541/0 lens 504/448 e 0 to 0 dl 1785787696 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785787685.820206:0:6622:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91907be0e300 with x1872533744849408 ext(0->12) 00010000:00010000:0.0:1785787685.820212:0:6622:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c693aad9/0xe2c2ff68a6e84e5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd523 expref: 9 pid: 6619 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.820228:0:6622:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c693aad9/0xe2c2ff68a6e84e5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd523 expref: 9 pid: 6619 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785787685.820236:0:6622:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff91907be0e300 00000100:00100000:0.0:1785787685.824887:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787685.824960:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744849536 00000100:00100000:3.0:1785787685.824969:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744849536 00010000:00010000:3.0:1785787685.825002:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c693aad9/0xe2c2ff68a6e84e5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd523 expref: 9 pid: 6619 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787685.825043:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 61 00000100:00100000:3.0:1785787685.825052:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79280304-55c6-4698-bfc3-29d14648ba45+9:2390:x1872533744849536:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785787685.825065:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1785787685.825082:0:5807:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1785787685.825085:0:5807:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1785787685 00002000:00010000:3.0:1785787685.825087:0:5807:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1785787686 00002000:00010000:3.0:1785787685.825100:0:5807:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1785787685 00010000:00010000:3.0:1785787685.825107:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c693aad9/0xe2c2ff68a6e84e5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd523 expref: 9 pid: 6619 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787685.825120:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c693aad9/0xe2c2ff68a6e84e5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd523 expref: 9 pid: 6619 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787685.825144:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c693aad9/0xe2c2ff68a6e84e5d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd523 expref: 9 pid: 6619 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787685.825159:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1785787685.825163:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1785787685.825170:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e4bc86fe/0xe2c2ff68a6e84eaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787685.825180:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4bc86fe/0xe2c2ff68a6e84eaa lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787685.825211:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787685.825255:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79280304-55c6-4698-bfc3-29d14648ba45+8:2390:x1872533744849536:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 203us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787685.825262:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 61 00010000:00010000:0.0:1785787685.825609:0:6617:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e4bc86fe/0xe2c2ff68a6e84eaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.825618:0:6617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4bc86fe/0xe2c2ff68a6e84eaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.825642:0:6617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4bc86fe/0xe2c2ff68a6e84eaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.825651:0:6617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4bc86fe/0xe2c2ff68a6e84eaa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.825659:0:6617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4bc86fe/0xe2c2ff68a6e84eaa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.825666:0:6617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919052f5ec00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:0.0:1785787685.825670:0:6617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4bc86fe/0xe2c2ff68a6e84eaa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.825679:0:6617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4bc86fe/0xe2c2ff68a6e84eaa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.825698:0:6617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4bc86fe/0xe2c2ff68a6e84eaa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.825706:0:6617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4bc86fe/0xe2c2ff68a6e84eaa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787685.825759:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:79280304-55c6-4698-bfc3-29d14648ba45+7:2390:x1872533744849280:12345-192.168.203.53@tcp:1:lfs.0 Request processed in 9726us (9856us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787685.825767:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 49 00000100:00100000:0.0:1785787685.834731:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787685.834801:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744849792 00000100:00100000:1.0:1785787685.834811:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744849792 00000100:00100000:1.0:1785787685.834893:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 38 00000100:00100000:1.0:1785787685.834903:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190451be050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+25:11402:x1872533744849792:12345-192.168.203.53@tcp:35:lfs.0 00000004:00010000:1.0:1785787685.834962:0:5823:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e84e9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd53f expref: 25 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785787685.835175:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1785787685.835213:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1785787685.838800:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1785787685.839561:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84eb1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787685.839678:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fe00/0xe2c2ff68a6e84e48 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd515 expref: 29 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787685.839689:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84eb1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787685.839726:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fe00/0xe2c2ff68a6e84e48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd515 expref: 29 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787685.839739:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fe00/0xe2c2ff68a6e84e48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd515 expref: 29 pid: 5820 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787685.839753:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bb60a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5823:1872533770027776:192.168.203.53@tcp:104: 00000100:00100000:1.0:1785787685.839891:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set ffff91907fe40d80 going to sleep for 11 seconds 00000100:00100000:1.0:1785787685.848228:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bb60a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5823:1872533770027776:192.168.203.53@tcp:104: 00010000:00010000:1.0:1785787685.848260:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84eb1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787685.856950:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787685.857211:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744849920 00000100:00100000:3.0:1785787685.857220:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744849920 00010000:00010000:3.0:1785787685.857257:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fe00/0xe2c2ff68a6e84e48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd515 expref: 30 pid: 5820 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787685.857288:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 62 00000100:00100000:3.0:1785787685.857308:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41d9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79280304-55c6-4698-bfc3-29d14648ba45+30:2391:x1872533744849920:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785787685.857332:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787685.857340:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fe00/0xe2c2ff68a6e84e48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd515 expref: 30 pid: 5820 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787685.857353:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fe00/0xe2c2ff68a6e84e48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd515 expref: 30 pid: 5820 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787685.857372:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fe00/0xe2c2ff68a6e84e48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd515 expref: 30 pid: 5820 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787685.857505:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff919059e3e800) 00010000:00010000:3.0:1785787685.857512:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84eb1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787685.857522:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84eb1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787685.857530:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84eb1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787685.857562:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787685.857608:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41d9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79280304-55c6-4698-bfc3-29d14648ba45+29:2391:x1872533744849920:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 301us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787685.857616:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 62 00010000:00010000:0.0:1785787685.857671:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84eb1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787685.857679:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84eb1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785787685.857783:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1785787685.857983:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1785787685.858076:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41d9ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5823:1872533770027904:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1785787685.858115:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787685.858136:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set ffff919076ddf000 going to sleep for 11 seconds 00000100:00100000:3.0:1785787685.858605:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770027904 00000100:00100000:3.0:1785787685.858610:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770027904 00000100:00100000:3.0:1785787685.858646:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1785787685.858653:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41d9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5823:x1872533770027904:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1785787685.858726:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41d9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5823:x1872533770027904:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 73us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787685.858733:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1785787685.858805:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41d9ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5823:1872533770027904:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1785787685.859183:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1785787685.866456:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41d9ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5823:1872533770028032:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1785787685.866521:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787685.866588:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905064a180 going to sleep for 11 seconds 00000100:00100000:3.0:1785787685.871572:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770028032 00000100:00100000:3.0:1785787685.871585:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770028032 00000100:00100000:2.0:1785787685.877434:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1785787685.877446:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5823:x1872533770028032:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1785787685.878476:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5823:x1872533770028032:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 1030us (11953us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1785787685.878485:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1785787685.882151:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41d9ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5823:1872533770028032:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1785787685.882479:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1785787685.882537:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84eb1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787685.882548:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84eb1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787685.882556:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84eb1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787685.882563:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0ea00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787685.882567:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84eb1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787685.882575:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84eb1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787685.882591:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff919059e3e800) 00010000:00010000:1.0:1785787685.882594:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1785787685.882597:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84eb1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787685.882603:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e84eb1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785787685.882801:0:5823:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1785787685.883598:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1785787685.883610:0:5823:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 473127780923ns, next at 474127778820ns, rc = 0 00000001:00080000:1.0:1785787685.883617:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1785787685.883651:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff919059e3e800) 00010000:00010000:1.0:1785787685.883655:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1785787685.883662:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e84e9c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd53f expref: 33 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787685.883773:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190451be050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+32:11402:x1872533744849792:12345-192.168.203.53@tcp:35:lfs.0 Request processed in 48870us (49048us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1785787685.883782:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 38 00000020:00080000:1.0:1785787685.883787:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1785787685.900702:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787685.900807:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744850048 00000100:00100000:2.0:1785787685.900817:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744850048 00000100:00100000:2.0:1785787685.900893:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 148 00000100:00100000:2.0:1785787685.900902:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41d9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+32:11402:x1872533744850048:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:2.0:1785787685.900927:0:9295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787685.900948:0:9295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d600/0xe2c2ff68a6e84eb8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd546 expref: -99 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787685.901001:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d600/0xe2c2ff68a6e84eb8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd546 expref: 33 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787685.901014:0:9295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d600/0xe2c2ff68a6e84eb8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd546 expref: 33 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787685.901030:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9190481f9600) 00010000:00010000:2.0:1785787685.901034:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1785787685.901037:0:9295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677d600, rc 0) 00000100:00100000:2.0:1785787685.901090:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41d9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+33:11402:x1872533744850048:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 189us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787685.901097:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 148 00000100:00100000:3.0:1785787685.906911:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787685.907039:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744850304 00000100:00100000:2.0:1785787685.907048:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744850304 00000100:00100000:2.0:1785787685.907100:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 39 00000100:00100000:2.0:1785787685.907109:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+33:11402:x1872533744850304:12345-192.168.203.53@tcp:35:lfs.0 00000100:00100000:2.0:1785787685.907310:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+34:11402:x1872533744850304:12345-192.168.203.53@tcp:35:lfs.0 Request processed in 202us (407us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1785787685.907317:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 39 00000100:00100000:1.0:1785787686.012134:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787686.012309:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744850560 00000100:00100000:3.0:1785787686.012436:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744850560 00000100:00100000:3.0:1785787686.012501:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 149 00000100:00100000:3.0:1785787686.012511:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+34:11412:x1872533744850560:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:3.0:1785787686.012533:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787686.012552:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84ebf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd54d expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785787686.013520:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1785787686.013634:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84ebf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd54d expref: 36 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787686.013648:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9190481f9b00) 00010000:00010000:3.0:1785787686.013652:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785787686.013656:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84ebf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd54d expref: 36 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787686.013670:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f902600, rc 0) 00000100:00100000:3.0:1785787686.013729:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+35:11412:x1872533744850560:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 1219us (1602us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1785787686.013736:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 149 00000100:00100000:0.0:1785787686.023525:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787686.028817:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744850688 00000100:00100000:2.0:1785787686.028840:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744850688 00000100:00100000:2.0:1785787686.031759:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 150 00000100:00100000:2.0:1785787686.031779:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41d9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+35:11412:x1872533744850688:12345-192.168.203.53@tcp:34:lfs.0 00010000:00010000:2.0:1785787686.031874:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84ecd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787686.031890:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84ecd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787686.031902:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84ecd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787686.031917:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84ed4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787686.031924:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787686.031931:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787686.032033:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84edb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787686.032054:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84edb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787686.032061:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84edb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785787686.032101:0:9295:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84edb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787686.032113:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84ecd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787686.032119:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84ecd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787686.032125:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84ecd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787686.032131:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677d000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787686.032134:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84ecd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787686.032142:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84ecd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787686.032152:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff919059e3e900) 00010000:00010000:2.0:1785787686.032155:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787686.032158:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84ecd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787686.032164:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84ecd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787686.032183:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787686.032189:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84ed4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787686.032195:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84ed4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787686.032200:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677d800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787686.032203:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84ed4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787686.032209:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84ed4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787686.032216:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9190481f9c00) 00010000:00010000:2.0:1785787686.032219:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787686.032222:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84ed4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787686.032228:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84ed4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787686.032242:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84edb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787686.032248:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84edb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787686.032254:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84edb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787686.032265:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677cc00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787686.032268:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84edb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787686.032275:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84edb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787686.032283:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9190481f9600) 00010000:00010000:2.0:1785787686.032286:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787686.032288:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84edb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787686.032294:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84edb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787686.032371:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41d9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+35:11412:x1872533744850688:12345-192.168.203.53@tcp:34:lfs.0 Request processed in 600us (8853us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787686.032379:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 150 00000100:00100000:1.0:1785787686.048657:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787686.048781:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744850944 00000100:00100000:2.0:1785787686.048791:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744850944 00000100:00100000:2.0:1785787686.048865:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 40 00000100:00100000:2.0:1785787686.048875:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+35:11412:x1872533744850944:12345-192.168.203.53@tcp:35:lfs.0 00000100:00100000:2.0:1785787686.049092:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+36:11412:x1872533744850944:12345-192.168.203.53@tcp:35:lfs.0 Request processed in 218us (444us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1785787686.049100:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 40 00000100:00100000:1.0:1785787686.143890:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787686.144749:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744851200 00000100:00100000:0.0:1785787686.144758:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744851200 00000100:00100000:0.0:1785787686.144816:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 151 00000100:00100000:0.0:1785787686.144857:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+36:11415:x1872533744851200:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:0.0:1785787686.144879:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787686.144900:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fa00/0xe2c2ff68a6e84ee2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd554 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787686.145089:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e800/0xe2c2ff68a6e84ee9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787686.145103:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e800/0xe2c2ff68a6e84ee9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787686.145114:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e800/0xe2c2ff68a6e84ee9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787686.145126:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e84ef0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787686.145132:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e84ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787686.145138:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e84ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787686.145247:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e84ef7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787686.145255:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e84ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787686.145274:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e84ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785787686.145284:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1785787686.145364:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e800/0xe2c2ff68a6e84ee9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787686.145371:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e800/0xe2c2ff68a6e84ee9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787686.145377:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e800/0xe2c2ff68a6e84ee9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787686.145383:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919052f5e800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1785787686.145387:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e800/0xe2c2ff68a6e84ee9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787686.145394:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e800/0xe2c2ff68a6e84ee9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787686.145405:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff919059e3e900) 00010000:00010000:0.0:1785787686.145408:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785787686.145413:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e800/0xe2c2ff68a6e84ee9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787686.145418:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e800/0xe2c2ff68a6e84ee9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787686.145431:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e84ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787686.145436:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e84ef0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787686.145457:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e84ef0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787686.145462:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919052f5f800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1785787686.145466:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e84ef0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787686.145472:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e84ef0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787686.145479:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff919059e3ed00) 00010000:00010000:0.0:1785787686.145482:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785787686.145485:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e84ef0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787686.145491:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e84ef0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787686.145529:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fa00/0xe2c2ff68a6e84ee2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd554 expref: 39 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787686.145540:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e84ef7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd554 expref: 38 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787686.145547:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9190481f9600) 00010000:00010000:0.0:1785787686.145549:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785787686.145551:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919052f5ee00, rc 0) 00000100:00100000:0.0:1785787686.146557:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+38:11415:x1872533744851200:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 1730us (2673us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1785787686.146574:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 151 00000100:00100000:0.0:1785787686.165699:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787686.165850:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744851328 00000100:00100000:3.0:1785787686.165859:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744851328 00000100:00100000:3.0:1785787686.165916:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 152 00000100:00100000:3.0:1785787686.165925:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+38:11415:x1872533744851328:12345-192.168.203.53@tcp:54:lfs.0 00010000:00010000:3.0:1785787686.165994:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84f05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787686.166010:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84f05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787686.166021:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84f05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787686.166045:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84f05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787686.166052:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84f05 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787686.166059:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84f05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787686.166064:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f902600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787686.166068:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84f05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787686.166075:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84f05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787686.166086:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9190481f9600) 00010000:00010000:3.0:1785787686.166088:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785787686.166093:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84f05 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787686.166111:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84f05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787686.166167:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+38:11415:x1872533744851328:12345-192.168.203.53@tcp:54:lfs.0 Request processed in 243us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787686.166175:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 152 00000100:00100000:1.0:1785787686.167971:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787686.168038:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744851584 00000100:00100000:3.0:1785787686.168044:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744851584 00000100:00100000:3.0:1785787686.168083:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 41 00000100:00100000:3.0:1785787686.168091:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+38:11415:x1872533744851584:12345-192.168.203.53@tcp:35:lfs.0 00000100:00100000:3.0:1785787686.168259:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+39:11415:x1872533744851584:12345-192.168.203.53@tcp:35:lfs.0 Request processed in 167us (291us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1785787686.168266:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 41 00000100:00100000:2.0:1785787686.323533:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190514f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770028160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785787686.323611:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787686.323754:0:6621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770028160 00000100:00100000:0.0:1785787686.323762:0:6621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770028160 00000100:00100000:0.0:1785787686.323813:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1785787686.323822:0:6621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bc19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770028160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785787686.323875:0:6621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785787686.323922:0:6621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bc19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770028160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787686.323930:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1785787686.324127:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190514f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770028160:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785787686.387179:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785787686.608554:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787686.609702:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744851840 00000100:00100000:3.0:1785787686.609711:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744851840 00000100:00100000:3.0:1785787686.609773:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 153 00000100:00100000:3.0:1785787686.609782:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+39:11447:x1872533744851840:12345-192.168.203.53@tcp:101:cat.0 00010000:00010000:3.0:1785787686.609804:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787686.609823:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84f0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd55b expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787686.609948:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e84f13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787686.609962:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e84f13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787686.609988:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e84f13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785787686.610000:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1785787686.610116:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84f0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd55b expref: 42 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787686.610134:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e84f13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd55b expref: 41 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787686.610142:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9190481f9600) 00010000:00010000:3.0:1785787686.610145:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785787686.610148:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f903200, rc 0) 00000100:00100000:3.0:1785787686.610194:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+41:11447:x1872533744851840:12345-192.168.203.53@tcp:101:cat.0 Request processed in 414us (1650us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1785787686.610201:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 153 00000100:00100000:0.0:1785787686.614141:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787686.614212:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787686.614297:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744852224 00000100:00100000:1.0:1785787686.614305:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744852224 00000100:00100000:1.0:1785787686.614373:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 13 00000100:00100000:1.0:1785787686.614382:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051467c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79280304-55c6-4698-bfc3-29d14648ba45+41:2391:x1872533744852224:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785787686.614395:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785787686.614417:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e84f13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd55b expref: 41 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787686.614459:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9190481f9600) 00010000:00010000:1.0:1785787686.614463:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785787686.614509:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051467c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79280304-55c6-4698-bfc3-29d14648ba45+40:2391:x1872533744852224:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 128us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787686.614516:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 13 00000100:00100000:3.0:1785787686.615328:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744852096 00000100:00100000:3.0:1785787686.615334:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744852096 00000100:00100000:3.0:1785787686.615463:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 42 00000100:00100000:3.0:1785787686.615472:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+40:11447:x1872533744852096:12345-192.168.203.53@tcp:35:cat.0 00000100:00100000:3.0:1785787686.615894:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+41:11447:x1872533744852096:12345-192.168.203.53@tcp:35:cat.0 Request processed in 422us (1758us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1785787686.615901:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 42 00000100:00100000:0.0:1785787686.678377:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787686.678506:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744852480 00000100:00100000:3.0:1785787686.678515:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744852480 00000100:00100000:3.0:1785787686.678570:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 154 00000100:00100000:3.0:1785787686.678580:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190776f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+41:11453:x1872533744852480:12345-192.168.203.53@tcp:101:dd.0 00010000:00010000:3.0:1785787686.678608:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787686.678612:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1785787686.678637:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84e79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd531 expref: 41 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787686.678656:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff919059e3e900) 00010000:00010000:3.0:1785787686.678670:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785787686.678683:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84f21 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd562 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787686.678767:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84f28 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787686.678780:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e84ef7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd554 expref: 41 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787686.678789:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84f28 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787686.678816:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e84ef7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd554 expref: 41 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787686.678877:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e84ef7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd554 expref: 41 pid: 5820 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787686.678891:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907be0df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5822:1872533770028288:192.168.203.53@tcp:104: 00000100:00100000:3.0:1785787686.678968:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff91907fdff0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785787686.682689:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787686.682808:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907be0df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5822:1872533770028288:192.168.203.53@tcp:104: 00010000:00010000:3.0:1785787686.682872:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84f28 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787686.682929:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744852608 00000100:00100000:0.0:1785787686.682936:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744852608 00010000:00010000:0.0:1785787686.682965:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e84ef7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd554 expref: 42 pid: 5820 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787686.682991:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 63 00000100:00100000:0.0:1785787686.682998:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79280304-55c6-4698-bfc3-29d14648ba45+42:2390:x1872533744852608:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785787686.683009:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785787686.683016:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e84ef7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd554 expref: 42 pid: 5820 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787686.683027:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e84ef7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd554 expref: 42 pid: 5820 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787686.683056:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e84ef7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd554 expref: 42 pid: 5820 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787686.683069:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9190481f9600) 00010000:00010000:0.0:1785787686.683074:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84f28 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787686.683082:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84f28 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787686.683089:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84f28 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787686.683114:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785787686.683160:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79280304-55c6-4698-bfc3-29d14648ba45+41:2390:x1872533744852608:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 162us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787686.683167:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 63 00010000:00010000:3.0:1785787686.683506:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84f28 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787686.683513:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84f28 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785787686.683530:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1785787686.683676:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84f21 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd562 expref: 42 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787686.683692:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84f28 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd562 expref: 41 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787686.683699:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9190481f9600) 00010000:00010000:3.0:1785787686.683702:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1785787686.683704:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f903e00, rc 0) 00000100:00100000:3.0:1785787686.683738:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190776f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+41:11453:x1872533744852480:12345-192.168.203.53@tcp:101:dd.0 Request processed in 5161us (5370us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1785787686.683745:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 154 00000100:00100000:1.0:1785787686.689121:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787686.689190:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744852864 00000100:00100000:3.0:1785787686.689200:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744852864 00000100:00100000:3.0:1785787686.689256:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 155 00000100:00100000:3.0:1785787686.689267:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+41:11453:x1872533744852864:12345-192.168.203.53@tcp:36:dd.0 00010000:00010000:3.0:1785787686.689525:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e84f36 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787686.689557:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e84f36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787686.689568:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e84f36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785787686.689618:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1785787686.689643:0:5821:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000064aac85a reply state 0000000082d22ef4 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e84f36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787686.689652:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785787686.689746:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+44:11453:x1872533744852864:12345-192.168.203.53@tcp:36:dd.0 Request processed in 480us (632us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1785787686.689753:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 155 00000020:00080000:3.0:1785787686.689758:0:5821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1785787686.692419:0:3319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e84f36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787686.692433:0:3319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e84f36 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787686.692439:0:3319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e84f36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787686.692454:0:3319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f902800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787686.692459:0:3319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e84f36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787686.692466:0:3319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e84f36 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787686.692479:0:3319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9190481f9600) 00010000:00010000:2.0:1785787686.692482:0:3319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787686.692486:0:3319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e84f36 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787686.692491:0:3319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e84f36 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785787686.928674:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967435 is committed 00000004:00080000:1.0:1785787686.928702:0:5843:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1785787686.928726:0:5843:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91907fe409c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1785787686.928731:0:5843:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff91904824e700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91907fe40d80 00000020:00080000:1.0:1785787686.928734:0:5843:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff91904824e600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff919076dd6000 00000001:00080000:1.0:1785787686.928770:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967441 is committed 00000020:00080000:0.0:1785787686.928851:0:5854:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1785787686.929020:0:5854:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1785787686.929659:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907be0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770028416:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1785787686.929725:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787686.929866:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770028416 00000100:00100000:3.0:1785787686.929874:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770028416 00000100:00100000:3.0:1785787686.929916:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1785787686.929924:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3335:x1872533770028416:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1785787686.929948:0:6618:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:3.0:1785787686.929976:0:6618:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a70f525, atime: 0x6a70f526, ctime: 0x6a70f525, blocks: 0x1 00010000:00010000:3.0:1785787686.929983:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c693aad9/0xe2c2ff68a6e84f3d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787686.929998:0:6618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=474s v=(0 0) 00010000:00010000:3.0:1785787686.930002:0:6618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785787686.930008:0:6618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c693aad9/0xe2c2ff68a6e84f3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787686.930037:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c693aad9/0xe2c2ff68a6e84f3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787686.930046:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c693aad9/0xe2c2ff68a6e84f3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787686.930054:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c693aad9/0xe2c2ff68a6e84f3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787686.930076:0:6618:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1785787686.930518:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3335:x1872533770028416:12345-0@lo:6:osp-syn-0-0.0 Request processed in 594us (792us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1785787686.930526:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:2.0:1785787686.930559:0:3335:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91907be0df80/2, rc 0, transno 4294967307 00000100:00100000:2.0:1785787686.930565:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907be0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770028416:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1785787686.930634:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785787686.930640:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c693aad9/0xe2c2ff68a6e84f3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787686.930648:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f902600 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785787686.930652:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c693aad9/0xe2c2ff68a6e84f3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787686.930661:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c693aad9/0xe2c2ff68a6e84f3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787686.930684:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c693aad9/0xe2c2ff68a6e84f3d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787686.930692:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c693aad9/0xe2c2ff68a6e84f3d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787686.930711:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787686.930713:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787686.930714:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785787687.136361:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787687.136474:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744852992 00000100:00100000:2.0:1785787687.136483:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744852992 00000100:00100000:2.0:1785787687.136551:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 156 00000100:00100000:2.0:1785787687.136562:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+16:11467:x1872533744852992:12345-192.168.203.53@tcp:101:stat.0 00000100:00080000:3.0:1785787687.136600:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1785787687.136602:0:9295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787687.136623:0:9295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84f44 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd569 expref: -99 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.136697:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84f4b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.136711:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84f4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.136724:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84f4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.136736:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e84f52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.136742:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e84f52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.136748:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e84f52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.137115:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84f59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.137126:0:9295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84f28 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd562 expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.137134:0:9295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84f59 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.137164:0:9295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84f28 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd562 expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.137184:0:9295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84f28 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd562 expref: 17 pid: 5822 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787687.137199:0:9295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bc1b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9295:1872533770028544:192.168.203.53@tcp:104: 00000100:00100000:2.0:1785787687.137292:0:9295:0:(client.c:2702:ptlrpc_set_wait()) set ffff918f42eee240 going to sleep for 11 seconds 00000100:00100000:0.0:1785787687.145856:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787687.145948:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744853248 00000100:00100000:1.0:1785787687.145958:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744853248 00000100:00100000:1.0:1785787687.146018:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 43 00000100:00100000:1.0:1785787687.146026:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190776f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+18:5608:x1872533744853248:12345-192.168.203.53@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1785787687.146438:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190776f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+19:5608:x1872533744853248:12345-192.168.203.53@tcp:35:ldlm_bl.0 Request processed in 411us (613us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1785787687.146455:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 43 00000100:00100000:2.0:1785787687.148610:0:9295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bc1b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9295:1872533770028544:192.168.203.53@tcp:104: 00010000:00010000:2.0:1785787687.148637:0:9295:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84f59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787687.156047:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787687.156128:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744853376 00000100:00100000:3.0:1785787687.156138:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744853376 00010000:00010000:3.0:1785787687.156177:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84f28 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd562 expref: 19 pid: 5822 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787687.156226:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 64 00000100:00100000:3.0:1785787687.156236:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79280304-55c6-4698-bfc3-29d14648ba45+19:2391:x1872533744853376:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785787687.156249:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787687.156256:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84f28 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd562 expref: 19 pid: 5822 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787687.156286:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84f28 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd562 expref: 19 pid: 5822 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787687.156307:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84f28 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd562 expref: 19 pid: 5822 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787687.156485:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9190481f9600) 00010000:00010000:3.0:1785787687.156490:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84f59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787687.156498:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84f59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787687.156505:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84f59 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787687.156534:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787687.156597:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79280304-55c6-4698-bfc3-29d14648ba45+18:2391:x1872533744853376:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 362us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787687.156605:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 64 00010000:00010000:2.0:1785787687.156669:0:9295:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84f59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.156678:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84f59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787687.156719:0:9295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1785787687.156724:0:9295:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785787687.156743:0:9295:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84f59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.156754:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84f59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.156763:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84f4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.156769:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84f4b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.156787:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84f4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.156792:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677ca00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787687.156796:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84f4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.156804:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84f4b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.156813:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff919059e3e900) 00010000:00010000:2.0:1785787687.156816:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787687.156819:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84f4b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.156825:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e84f4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.156870:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e84f52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.156877:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e84f52 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.156882:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e84f52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.156887:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677c800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787687.156889:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e84f52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.156905:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e84f52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.156915:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9190481f9c00) 00010000:00010000:2.0:1785787687.156917:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787687.156920:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e84f52 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.156927:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e84f52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.156959:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e84f44 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd569 expref: 18 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.156972:0:9295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84f59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd569 expref: 17 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.156979:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9190481f9600) 00010000:00010000:2.0:1785787687.156982:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785787687.156984:0:9295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677d800, rc 0) 00000100:00100000:2.0:1785787687.157010:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+17:11467:x1872533744852992:12345-192.168.203.53@tcp:101:stat.0 Request processed in 20451us (20660us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787687.157017:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 156 00000100:00100000:3.0:1785787687.271076:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787687.271165:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744853632 00000100:00100000:0.0:1785787687.271174:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744853632 00000100:00100000:0.0:1785787687.271237:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 157 00000100:00100000:0.0:1785787687.271247:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+17:11473:x1872533744853632:12345-192.168.203.53@tcp:36:truncate.0 00010000:00010000:0.0:1785787687.271300:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785787687.271326:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e84f59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd569 expref: 17 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787687.271364:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9190481f9600) 00010000:00010000:0.0:1785787687.271369:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785787687.271567:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e84f60 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787687.271754:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e84f60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787687.271765:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e84f60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785787687.271817:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1785787687.271883:0:5821:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d3a15cb1 reply state 00000000337d79ae transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e84f60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787687.271892:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785787687.271984:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+19:11473:x1872533744853632:12345-192.168.203.53@tcp:36:truncate.0 Request processed in 738us (916us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1785787687.271990:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 157 00000020:00080000:0.0:1785787687.271994:0:5821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1785787687.276502:0:3320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e84f60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787687.276519:0:3320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e84f60 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787687.276526:0:3320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e84f60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787687.276548:0:3320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919052f5fc00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787687.276552:0:3320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e84f60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787687.276560:0:3320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e84f60 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787687.276575:0:3320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9190481f9600) 00010000:00010000:1.0:1785787687.276578:0:3320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785787687.276582:0:3320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e84f60 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787687.276587:0:3320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e84f60 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787687.411044:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787687.488950:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787687.489047:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744853760 00000100:00100000:0.0:1785787687.489056:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744853760 00000100:00100000:0.0:1785787687.489124:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 158 00000100:00100000:0.0:1785787687.489134:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+18:11487:x1872533744853760:12345-192.168.203.53@tcp:101:stat.0 00010000:00010000:0.0:1785787687.489158:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787687.489184:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e84f67 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd570 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787687.489268:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e84f6e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787687.489281:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e84f6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787687.489292:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e84f6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787687.489310:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f400/0xe2c2ff68a6e84f75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787687.489317:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f400/0xe2c2ff68a6e84f75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787687.489323:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f400/0xe2c2ff68a6e84f75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787687.489640:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e84f7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787687.489650:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e84f7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787687.489658:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e84f7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785787687.489690:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1785787687.489694:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1785787687.489713:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e84f7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787687.489735:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e84f7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787687.489744:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e84f6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787687.489751:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e84f6e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787687.489758:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e84f6e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787687.489765:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919052f5fc00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1785787687.489769:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e84f6e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787687.489776:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e84f6e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787687.489787:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff919059e3e900) 00010000:00010000:0.0:1785787687.489790:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785787687.489794:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e84f6e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787687.489813:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e84f6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787687.489825:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f400/0xe2c2ff68a6e84f75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787687.489891:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f400/0xe2c2ff68a6e84f75 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787687.489904:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f400/0xe2c2ff68a6e84f75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787687.489910:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919052f5f400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1785787687.489913:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f400/0xe2c2ff68a6e84f75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787687.489920:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f400/0xe2c2ff68a6e84f75 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787687.489929:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff919059e3e600) 00010000:00010000:0.0:1785787687.489931:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785787687.489934:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f400/0xe2c2ff68a6e84f75 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787687.489941:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f400/0xe2c2ff68a6e84f75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787687.489969:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e84f67 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd570 expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787687.489983:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e84f7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd570 expref: 19 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787687.489990:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9190481f9600) 00010000:00010000:0.0:1785787687.489992:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785787687.489995:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919052f5ee00, rc 0) 00000100:00100000:0.0:1785787687.490069:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+19:11487:x1872533744853760:12345-192.168.203.53@tcp:101:stat.0 Request processed in 935us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787687.490083:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 158 00000100:00100000:0.0:1785787687.633597:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787687.634264:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744854016 00000100:00100000:1.0:1785787687.634274:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744854016 00000100:00100000:1.0:1785787687.634339:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 159 00000100:00100000:1.0:1785787687.634349:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190776f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+19:11497:x1872533744854016:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:1.0:1785787687.634369:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787687.634390:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84f83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd577 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785787687.634633:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1785787687.634786:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84f83 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd577 expref: 21 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787687.634800:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9190481f9b00) 00010000:00010000:1.0:1785787687.634808:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785787687.634814:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84f83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd577 expref: 21 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787687.634826:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919043c0fe00, rc 0) 00000100:00100000:1.0:1785787687.634931:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190776f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+20:11497:x1872533744854016:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 583us (1342us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1785787687.634938:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 159 00000100:00100000:3.0:1785787687.639890:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787687.639993:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744854272 00000100:00100000:2.0:1785787687.640002:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744854272 00000100:00100000:2.0:1785787687.640056:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 44 00000100:00100000:2.0:1785787687.640064:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190451be850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+20:11497:x1872533744854272:12345-192.168.203.53@tcp:35:lfs.0 00000100:00100000:2.0:1785787687.640493:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190451be850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+21:11497:x1872533744854272:12345-192.168.203.53@tcp:35:lfs.0 Request processed in 429us (610us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1785787687.640501:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 44 00000100:00100000:3.0:1785787687.757190:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787687.757478:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744854528 00000100:00100000:0.0:1785787687.757488:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744854528 00000100:00100000:0.0:1785787687.757546:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 160 00000100:00100000:0.0:1785787687.757555:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+21:11503:x1872533744854528:12345-192.168.203.53@tcp:101:bash.0 00010000:00010000:0.0:1785787687.757587:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787687.757609:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f400/0xe2c2ff68a6e84f91 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd57e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787687.757703:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e84f98 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787687.757718:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e84f7c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd570 expref: 22 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787687.757726:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e84f98 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787687.757757:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e84f7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd570 expref: 22 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787687.757769:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e84f7c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd570 expref: 22 pid: 5822 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787687.757782:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190776f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5822:1872533770028672:192.168.203.53@tcp:104: 00000100:00100000:0.0:1785787687.757891:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190809c7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1785787687.765099:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787687.765197:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190776f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5822:1872533770028672:192.168.203.53@tcp:104: 00010000:00010000:3.0:1785787687.765221:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e84f98 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787687.765315:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744854656 00000100:00100000:1.0:1785787687.765322:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744854656 00010000:00010000:1.0:1785787687.765357:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e84f7c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd570 expref: 23 pid: 5822 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787687.765396:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 65 00000100:00100000:1.0:1785787687.765405:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190776f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79280304-55c6-4698-bfc3-29d14648ba45+23:2391:x1872533744854656:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785787687.765419:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785787687.765425:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e84f7c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd570 expref: 23 pid: 5822 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787687.765446:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e84f7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd570 expref: 23 pid: 5822 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787687.765467:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e84f7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd570 expref: 23 pid: 5822 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787687.765482:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9190481f9600) 00010000:00010000:1.0:1785787687.765486:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e84f98 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787687.765501:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e84f98 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787687.765508:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e84f98 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787687.765536:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785787687.765592:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190776f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79280304-55c6-4698-bfc3-29d14648ba45+22:2391:x1872533744854656:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 187us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787687.765599:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 65 00010000:00010000:0.0:1785787687.766084:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e84f98 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787687.766093:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e84f98 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785787687.766110:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1785787687.766240:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f400/0xe2c2ff68a6e84f91 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd57e expref: 23 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787687.766255:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e84f98 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd57e expref: 22 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787687.766262:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9190481f9600) 00010000:00010000:0.0:1785787687.766264:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1785787687.766267:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919052f5fc00, rc 0) 00000100:00100000:0.0:1785787687.766311:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+22:11503:x1872533744854528:12345-192.168.203.53@tcp:101:bash.0 Request processed in 8757us (9140us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1785787687.766318:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 160 00000100:00100000:0.0:1785787687.768241:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787687.768294:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744854912 00000100:00100000:1.0:1785787687.768311:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744854912 00000100:00100000:1.0:1785787687.768356:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 161 00000100:00100000:1.0:1785787687.768366:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190776f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+22:11503:x1872533744854912:12345-192.168.203.53@tcp:36:bash.0 00010000:00010000:1.0:1785787687.768584:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84fa6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787687.768599:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84fa6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787687.768609:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84fa6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785787687.768656:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1785787687.768679:0:5820:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007be12d83 reply state 000000000719cfab transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84fa6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787687.768689:0:5820:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785787687.768764:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190776f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+25:11503:x1872533744854912:12345-192.168.203.53@tcp:36:bash.0 Request processed in 399us (526us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1785787687.768783:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 161 00000020:00080000:1.0:1785787687.768787:0:5820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1785787687.770903:0:3319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84fa6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.770917:0:3319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84fa6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.770924:0:3319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84fa6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.770930:0:3319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0fe00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787687.770935:0:3319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84fa6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.770943:0:3319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84fa6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.770957:0:3319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9190481f9600) 00010000:00010000:2.0:1785787687.770960:0:3319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787687.770964:0:3319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84fa6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.770971:0:3319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84fa6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787687.785470:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787687.791000:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744855040 00000100:00100000:2.0:1785787687.791015:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744855040 00000100:00100000:2.0:1785787687.791136:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 162 00000100:00100000:2.0:1785787687.791147:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190776f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+24:11503:x1872533744855040:12345-192.168.203.53@tcp:101:bash.0 00010000:00010000:2.0:1785787687.791184:0:9295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787687.791205:0:9295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84fad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd585 expref: -99 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.791290:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84fb4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.791314:0:9295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e84f98 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd57e expref: 25 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.791322:0:9295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84fb4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.792020:0:9295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e84f98 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd57e expref: 25 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.792034:0:9295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e84f98 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd57e expref: 25 pid: 5822 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787687.792046:0:9295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bc1b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9295:1872533770028800:192.168.203.53@tcp:104: 00000100:00100000:2.0:1785787687.792130:0:9295:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190507db3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785787687.798218:0:9295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bc1b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9295:1872533770028800:192.168.203.53@tcp:104: 00010000:00010000:2.0:1785787687.798243:0:9295:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84fb4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787687.799517:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787687.799936:0:11051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744855168 00000100:00100000:3.0:1785787687.799944:0:11051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744855168 00010000:00010000:3.0:1785787687.799978:0:11051:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e84f98 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd57e expref: 26 pid: 5822 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787687.800013:0:11051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 66 00000100:00100000:3.0:1785787687.800022:0:11051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190776f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79280304-55c6-4698-bfc3-29d14648ba45+26:2391:x1872533744855168:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785787687.800033:0:11051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787687.800040:0:11051:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e84f98 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd57e expref: 26 pid: 5822 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787687.800051:0:11051:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e84f98 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd57e expref: 26 pid: 5822 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787687.800070:0:11051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e84f98 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd57e expref: 26 pid: 5822 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787687.800086:0:11051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9190481f9600) 00010000:00010000:3.0:1785787687.800090:0:11051:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84fb4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787687.800100:0:11051:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787687.800108:0:11051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84fb4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787687.800131:0:11051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787687.800194:0:11051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190776f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79280304-55c6-4698-bfc3-29d14648ba45+25:2391:x1872533744855168:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 172us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787687.800201:0:11051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 66 00010000:00010000:2.0:1785787687.800340:0:9295:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.800348:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787687.800396:0:9295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1785787687.800400:0:9295:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785787687.800418:0:9295:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.800456:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e84fad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd585 expref: 25 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.800472:0:9295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84fb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd585 expref: 24 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787687.800480:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9190481f9600) 00010000:00010000:2.0:1785787687.800482:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785787687.800485:0:9295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677cc00, rc 0) 00000100:00100000:2.0:1785787687.800511:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190776f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+24:11503:x1872533744855040:12345-192.168.203.53@tcp:101:bash.0 Request processed in 9366us (15050us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787687.800518:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 162 00000100:00100000:3.0:1785787687.802554:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787687.802619:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744855424 00000100:00100000:2.0:1785787687.802626:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744855424 00000100:00100000:2.0:1785787687.802716:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 45 00000100:00100000:2.0:1785787687.802725:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+24:11503:x1872533744855424:12345-192.168.203.53@tcp:35:bash.0 00000100:00100000:2.0:1785787687.802938:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+25:11503:x1872533744855424:12345-192.168.203.53@tcp:35:bash.0 Request processed in 214us (388us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1785787687.802946:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 45 00000100:00100000:0.0:1785787687.914671:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787687.921511:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744855680 00000100:00100000:1.0:1785787687.921524:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744855680 00000100:00100000:1.0:1785787687.921637:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 163 00000100:00100000:1.0:1785787687.921647:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190776f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+25:11513:x1872533744855680:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:1.0:1785787687.921670:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787687.921691:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84fbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd58c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785787687.921953:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1785787687.922116:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84fbb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd58c expref: 27 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787687.922131:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9190481f9b00) 00010000:00010000:1.0:1785787687.922135:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785787687.922139:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e84fbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd58c expref: 27 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787687.922152:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919043c0fe00, rc 0) 00000100:00100000:1.0:1785787687.922216:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190776f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+26:11513:x1872533744855680:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 571us (7552us total) trans 4294967451 rc 301/301 00000100:00100000:1.0:1785787687.922224:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 163 00000100:00100000:0.0:1785787687.930464:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787687.930531:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744855808 00000100:00100000:3.0:1785787687.930540:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744855808 00000100:00100000:3.0:1785787687.930590:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 164 00000100:00100000:3.0:1785787687.930600:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190776f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+26:11513:x1872533744855808:12345-192.168.203.53@tcp:34:lfs.0 00010000:00010000:3.0:1785787687.930670:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84fc9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787687.930687:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84fc9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787687.930697:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84fc9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787687.930710:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84fd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787687.930717:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84fd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787687.930723:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84fd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787687.931059:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e84fd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787687.931069:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e84fd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787687.931085:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e84fd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785787687.931124:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e84fd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787687.931135:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84fc9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787687.931141:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84fc9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787687.931148:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84fc9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787687.931153:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903e00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787687.931157:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84fc9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787687.931164:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84fc9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787687.931174:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff919059e3e900) 00010000:00010000:3.0:1785787687.931177:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787687.931181:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84fc9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787687.931187:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84fc9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787687.931198:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84fd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787687.931209:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84fd0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787687.931215:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84fd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787687.931220:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f902600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787687.931223:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84fd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787687.931230:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84fd0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787687.931239:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff919055acdd00) 00010000:00010000:3.0:1785787687.931241:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787687.931244:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84fd0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787687.931250:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84fd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787687.931264:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e84fd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787687.931271:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e84fd7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787687.931276:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e84fd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787687.931281:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f902800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787687.931289:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e84fd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787687.931294:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e84fd7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787687.931313:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9190481f9600) 00010000:00010000:3.0:1785787687.931316:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787687.931319:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e84fd7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787687.931324:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e84fd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787687.931534:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190776f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+26:11513:x1872533744855808:12345-192.168.203.53@tcp:34:lfs.0 Request processed in 935us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787687.931542:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 164 00000100:00100000:2.0:1785787687.940472:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787687.945090:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744856064 00000100:00100000:1.0:1785787687.945103:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744856064 00000100:00100000:1.0:1785787687.945193:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 46 00000100:00100000:1.0:1785787687.945203:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bc1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+26:11513:x1872533744856064:12345-192.168.203.53@tcp:35:lfs.0 00000100:00100000:1.0:1785787687.947202:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bc1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+27:11513:x1872533744856064:12345-192.168.203.53@tcp:35:lfs.0 Request processed in 1997us (6735us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1785787687.947212:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 46 00000100:00100000:0.0:1785787688.016044:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787688.016116:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744856320 00000100:00100000:3.0:1785787688.016125:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744856320 00000100:00100000:3.0:1785787688.016181:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 165 00000100:00100000:3.0:1785787688.016191:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190776f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+27:11516:x1872533744856320:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:3.0:1785787688.016215:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787688.016235:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e84fde lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd593 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787688.016313:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e84fe5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787688.016333:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e84fe5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787688.016361:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e84fe5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787688.016375:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84fec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787688.016382:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84fec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787688.016387:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84fec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787688.016734:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84ff3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787688.016743:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787688.016750:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785787688.016760:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1785787688.016869:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e84fe5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787688.016876:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e84fe5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787688.016883:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e84fe5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787688.016888:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f902800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787688.016898:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e84fe5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787688.016905:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e84fe5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787688.016916:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff919059e3e900) 00010000:00010000:3.0:1785787688.016920:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787688.016924:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e84fe5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787688.016930:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e84fe5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787688.016942:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84fec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787688.016948:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84fec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787688.016953:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84fec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787688.016957:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f902600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787688.016960:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84fec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787688.016965:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84fec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787688.016971:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff919055acdd00) 00010000:00010000:3.0:1785787688.016973:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787688.016980:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84fec lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787688.016986:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e84fec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787688.017021:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e84fde lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd593 expref: 30 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787688.017033:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84ff3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd593 expref: 29 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787688.017040:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9190481f9600) 00010000:00010000:3.0:1785787688.017042:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785787688.017045:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f903e00, rc 0) 00000100:00100000:3.0:1785787688.017103:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190776f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+29:11516:x1872533744856320:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 913us (1066us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1785787688.017110:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 165 00000100:00100000:3.0:1785787688.020633:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787688.020721:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787688.022411:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744856576 00000100:00100000:1.0:1785787688.022420:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744856576 00000100:00100000:1.0:1785787688.022483:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 14 00000100:00100000:1.0:1785787688.022491:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79280304-55c6-4698-bfc3-29d14648ba45+29:2388:x1872533744856576:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785787688.022505:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785787688.022524:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e84ff3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd593 expref: 29 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787688.022541:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9190481f9600) 00010000:00010000:1.0:1785787688.022546:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785787688.022592:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79280304-55c6-4698-bfc3-29d14648ba45+28:2388:x1872533744856576:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 101us (1869us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787688.022600:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 14 00000100:00100000:2.0:1785787688.027929:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744856448 00000100:00100000:2.0:1785787688.027959:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744856448 00000100:00100000:2.0:1785787688.028019:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 166 00000100:00100000:2.0:1785787688.028028:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+28:11516:x1872533744856448:12345-192.168.203.53@tcp:54:lfs.0 00010000:00010000:2.0:1785787688.028092:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85001 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787688.028106:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85001 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787688.028117:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85001 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787688.028141:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85001 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787688.028147:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85001 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787688.028153:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85001 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787688.028159:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677ce00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787688.028163:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85001 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787688.028169:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85001 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787688.028179:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9190481f9600) 00010000:00010000:2.0:1785787688.028182:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785787688.028186:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85001 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787688.028203:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85001 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787688.028283:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+28:11516:x1872533744856448:12345-192.168.203.53@tcp:54:lfs.0 Request processed in 255us (7656us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787688.028290:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 166 00000100:00100000:3.0:1785787688.031590:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787688.031655:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744856832 00000100:00100000:1.0:1785787688.031663:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744856832 00000100:00100000:1.0:1785787688.031705:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 47 00000100:00100000:1.0:1785787688.031712:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+28:11516:x1872533744856832:12345-192.168.203.53@tcp:35:lfs.0 00000100:00100000:1.0:1785787688.031918:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+29:11516:x1872533744856832:12345-192.168.203.53@tcp:35:lfs.0 Request processed in 204us (332us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1785787688.031925:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 47 00000100:00100000:0.0:1785787688.219564:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787688.226304:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744857088 00000100:00100000:3.0:1785787688.226318:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744857088 00000100:00100000:3.0:1785787688.226481:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 167 00000100:00100000:3.0:1785787688.226492:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190776f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+29:11534:x1872533744857088:12345-192.168.203.53@tcp:101:cat.0 00010000:00010000:3.0:1785787688.226515:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787688.226536:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e85008 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd59a expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787688.227410:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e8500f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787688.227427:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e8500f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787688.227450:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e8500f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785787688.227463:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1785787688.227573:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e85008 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd59a expref: 32 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787688.227654:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e8500f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd59a expref: 31 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787688.227663:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9190481f9600) 00010000:00010000:3.0:1785787688.227667:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1785787688.227670:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f902600, rc 0) 00000100:00100000:3.0:1785787688.227738:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190776f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+31:11534:x1872533744857088:12345-192.168.203.53@tcp:101:cat.0 Request processed in 1248us (8184us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1785787688.227746:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 167 00000100:00100000:0.0:1785787688.266729:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787688.266910:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744857216 00000100:00100000:2.0:1785787688.266919:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744857216 00000100:00100000:2.0:1785787688.266971:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 168 00000100:00100000:2.0:1785787688.266979:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190776f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+31:11535:x1872533744857216:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:2.0:1785787688.267003:0:9295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787688.267022:0:9295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e8501d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd5a1 expref: -99 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787688.267081:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e85024 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787688.267094:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e85024 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787688.267104:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e85024 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787688.267287:0:9295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1785787688.267291:0:9295:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1785787688.267382:0:9295:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e85024 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787688.267410:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e8501d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5a1 expref: 33 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787688.267446:0:9295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e85024 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5a1 expref: 32 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787688.267456:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff919059e3e900) 00010000:00010000:2.0:1785787688.267459:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785787688.267462:0:9295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677da00, rc 0) 00000100:00100000:2.0:1785787688.267506:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190776f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+32:11535:x1872533744857216:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 528us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787688.267513:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 168 00000100:00100000:0.0:1785787688.278151:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787688.278302:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744857600 00000100:00100000:1.0:1785787688.278312:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744857600 00000100:00100000:1.0:1785787688.278440:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 48 00000100:00100000:1.0:1785787688.278451:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190776f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+32:11535:x1872533744857600:12345-192.168.203.53@tcp:35:lfs.0 00000100:00100000:1.0:1785787688.278736:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190776f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+33:11535:x1872533744857600:12345-192.168.203.53@tcp:35:lfs.0 Request processed in 286us (592us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1785787688.278744:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 48 00000100:00100000:0.0:1785787688.289052:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787688.289251:0:11051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744857728 00000100:00100000:3.0:1785787688.289260:0:11051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744857728 00000100:00100000:3.0:1785787688.290273:0:11051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 15 00000100:00100000:3.0:1785787688.290285:0:11051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190776f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79280304-55c6-4698-bfc3-29d14648ba45+33:11535:x1872533744857728:12345-192.168.203.53@tcp:103:lfs.0 00010000:00010000:3.0:1785787688.290502:0:11051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1785787688.290538:0:11051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e84fb4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd585 expref: 33 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787688.290560:0:11051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e8500f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd59a expref: 32 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787688.290572:0:11051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d600/0xe2c2ff68a6e84eb8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd546 expref: 31 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787688.291264:0:11051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9190481f9600) 00010000:00010000:3.0:1785787688.291277:0:11051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787688.291395:0:11051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190776f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79280304-55c6-4698-bfc3-29d14648ba45+30:11535:x1872533744857728:12345-192.168.203.53@tcp:103:lfs.0 Request processed in 1112us (2350us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787688.291403:0:11051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 15 00000100:00100000:0.0:1785787688.302236:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787688.302404:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744857856 00000100:00100000:1.0:1785787688.302413:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744857856 00000100:00100000:1.0:1785787688.302507:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 169 00000100:00100000:1.0:1785787688.302518:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190776f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+30:11535:x1872533744857856:12345-192.168.203.53@tcp:58:lfs.0 00010000:00010000:1.0:1785787688.302614:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e8502b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787688.302630:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e8502b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787688.302642:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e8502b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1785787688.302940:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1785787688.303009:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190776f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+30:11535:x1872533744857856:12345-192.168.203.53@tcp:58:lfs.0 Request processed in 493us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787688.303016:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 169 00000100:00100000:1.0:1785787688.340901:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787688.340982:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744857984 00000100:00100000:2.0:1785787688.340991:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744857984 00000100:00100000:2.0:1785787688.341044:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 170 00000100:00100000:2.0:1785787688.341053:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+30:11537:x1872533744857984:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:2.0:1785787688.341072:0:9295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787688.341092:0:9295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85032 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd5a8 expref: -99 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787688.341147:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e85039 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787688.341161:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e85039 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787688.341181:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e85039 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787688.341194:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e85040 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787688.341214:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e85040 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787688.341220:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e85040 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787688.341694:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e85047 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787688.341704:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e85047 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787688.341711:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e85047 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787688.341745:0:9295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1785787688.341749:0:9295:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785787688.341764:0:9295:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e85047 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787688.341775:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e85047 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787688.341782:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e85039 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787688.341788:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e85039 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787688.341794:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e85039 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787688.341808:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677ca00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787688.341812:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e85039 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787688.341820:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e85039 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787688.341856:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff919059e3e900) 00010000:00010000:2.0:1785787688.341859:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787688.341863:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e85039 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787688.341870:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e85039 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787688.341882:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e85040 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787688.341888:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e85040 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787688.341894:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e85040 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787688.341898:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677c800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787688.341901:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e85040 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787688.341907:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e85040 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787688.341923:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9190481f9c00) 00010000:00010000:2.0:1785787688.341925:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787688.341928:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e85040 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787688.341934:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e85040 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787688.341960:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85032 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5a8 expref: 32 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787688.341971:0:9295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e85047 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5a8 expref: 31 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787688.341978:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91905685f300) 00010000:00010000:2.0:1785787688.341980:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785787688.341983:0:9295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677d800, rc 0) 00000100:00100000:2.0:1785787688.342045:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+31:11537:x1872533744857984:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 992us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787688.342053:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 170 00000100:00100000:2.0:1785787688.375605:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785787688.375627:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bb63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770028928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785787688.375692:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787688.375881:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770028928 00000100:00100000:3.0:1785787688.375888:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770028928 00000100:00100000:3.0:1785787688.375946:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1785787688.375956:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bc19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3335:x1872533770028928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785787688.375987:0:6620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785787688.376038:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bc19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3335:x1872533770028928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787688.376045:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1785787688.376153:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bb63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770028928:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1785787688.376204:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1785787688.435042:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1785787688.942092:0:6642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:0.0:1785787688.942206:0:6642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:0.0:1785787688.942217:0:6642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000040:00080000:0.0:1785787689.138985:0:11564:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1785787689.138993:0:11564:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1785787689.139031:0:11564:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1785787689.139038:0:11564:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1785787689.139154:0:11564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190776f2300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11564:1872533770029056:192.168.203.53@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1785787689.139386:0:11564:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190770abc00 going to sleep for 11 seconds 00000100:00100000:0.0:1785787689.146439:0:11564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190776f2300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11564:1872533770029056:192.168.203.53@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1785787689.179516:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787689.179721:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744858112 00000100:00100000:0.0:1785787689.179730:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744858112 00000100:00100000:0.0:1785787689.179792:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 171 00000100:00100000:0.0:1785787689.179801:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+31:11548:x1872533744858112:12345-192.168.203.53@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1785787689.179846:0:5821:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1785787689.179939:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+31:11548:x1872533744858112:12345-192.168.203.53@tcp:53:lhsmtool_posix.0 Request processed in 139us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787689.179946:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 171 00000100:00080000:1.0:1785787689.180746:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785787689.182945:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787689.182972:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744858240 00000100:00100000:1.0:1785787689.182991:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744858240 00000100:00100000:1.0:1785787689.183032:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 172 00000100:00100000:1.0:1785787689.183040:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+31:11548:x1872533744858240:12345-192.168.203.53@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1785787689.183099:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e8504e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.183116:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e8504e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.183128:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e8504e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.183143:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e85055 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.183150:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e85055 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.183157:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e85055 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.183180:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e8505c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.183189:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e8505c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.183196:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e8505c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785787689.183225:0:9295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1785787689.183229:0:9295:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1785787689.183245:0:9295:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e8505c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.183256:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e8504e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.183263:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e8504e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.183271:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e8504e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.183277:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0f400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787689.183281:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e8504e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.183288:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e8504e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.183299:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9190481f9400) 00010000:00010000:1.0:1785787689.183302:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785787689.183306:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e8504e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.183312:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0f400/0xe2c2ff68a6e8504e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.183327:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e85055 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.183333:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e85055 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.183340:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e85055 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.183350:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0ea00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787689.183353:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e85055 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.183360:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e85055 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.183368:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff91905685f100) 00010000:00010000:1.0:1785787689.183370:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785787689.183373:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e85055 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.183379:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0ea00/0xe2c2ff68a6e85055 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.183393:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e8505c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.183400:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e8505c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.183406:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e8505c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.183411:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0fe00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787689.183413:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e8505c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.183419:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e8505c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.183449:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91905685f300) 00010000:00010000:1.0:1785787689.183451:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785787689.183454:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e8505c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.183461:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fe00/0xe2c2ff68a6e8505c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787689.183513:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+31:11548:x1872533744858240:12345-192.168.203.53@tcp:34:lhsmtool_posix.0 Request processed in 474us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787689.183521:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 172 00000100:00100000:0.0:1785787689.198454:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787689.198870:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744858496 00000100:00100000:3.0:1785787689.198880:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744858496 00000100:00100000:3.0:1785787689.198928:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 173 00000100:00100000:3.0:1785787689.198937:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190776f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+31:11548:x1872533744858496:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785787689.198965:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787689.198985:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e85063 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd5af expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.199090:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e8506a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.199105:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e8506a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.199117:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e8506a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785787689.199130:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1785787689.199227:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e8506a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.199235:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e8506a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.199242:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e8506a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.199248:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903200 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787689.199252:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e8506a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.199260:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e8506a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.199271:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91905685f300) 00010000:00010000:3.0:1785787689.199279:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785787689.199285:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e8506a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.199291:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e8506a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.199329:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e85063 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5af expref: 33 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.199340:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9190481f9400) 00010000:00010000:3.0:1785787689.199342:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785787689.199346:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e85063 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5af expref: 33 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.199355:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f902600, rc 0) 00000100:00100000:3.0:1785787689.199411:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190776f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+32:11548:x1872533744858496:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 476us (965us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1785787689.199419:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 173 00000100:00100000:1.0:1785787689.203434:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787689.203600:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744858624 00000100:00100000:3.0:1785787689.203609:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744858624 00000100:00100000:3.0:1785787689.203663:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 174 00000100:00100000:3.0:1785787689.203673:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+32:11548:x1872533744858624:12345-192.168.203.53@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1785787689.203704:0:9295:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1785787689.203795:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+32:11548:x1872533744858624:12345-192.168.203.53@tcp:53:lhsmtool_posix.0 Request processed in 124us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787689.203802:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 174 00000100:00100000:1.0:1785787689.214562:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787689.214862:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744858880 00000100:00100000:0.0:1785787689.214872:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744858880 00000100:00100000:0.0:1785787689.214928:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 175 00000100:00100000:0.0:1785787689.214938:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+32:11548:x1872533744858880:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1785787689.214968:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787689.214971:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1785787689.214997:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e85024 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5a1 expref: 32 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.215016:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff919059e3e900) 00010000:00010000:0.0:1785787689.215021:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785787689.215032:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fe00/0xe2c2ff68a6e85078 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd5b6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785787689.215715:0:5820:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1785787689.215949:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e8507f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.215963:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e8507f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.215972:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e8507f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.216019:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fe00/0xe2c2ff68a6e85078 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5b6 expref: 34 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.216033:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e8507f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5b6 expref: 33 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.216041:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff919059e3e600) 00010000:00010000:0.0:1785787689.216044:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785787689.216053:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919052f5f200, rc 0) 00000100:00100000:0.0:1785787689.216107:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+33:11548:x1872533744858880:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 1171us (1553us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1785787689.216115:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 175 00000100:00100000:0.0:1785787689.224965:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787689.225027:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744859136 00000100:00100000:3.0:1785787689.225102:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744859136 00000100:00100000:3.0:1785787689.225160:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 176 00000100:00100000:3.0:1785787689.225170:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190776f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+33:11548:x1872533744859136:12345-192.168.203.53@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1785787689.225221:0:9295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787689.225246:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e8507f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5b6 expref: 33 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.225262:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff919059e3e600) 00010000:00010000:3.0:1785787689.225272:0:9295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785787689.225291:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e8508d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.225305:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e8508d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.225315:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e8508d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.225329:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e85094 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x7c34ed66 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.225336:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e85094 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x7c34ed66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.225343:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e85094 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x7c34ed66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.225571:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e8508d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.225579:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e8508d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.225590:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e8508d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.225596:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f902600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787689.225600:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e8508d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.225607:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e8508d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.225615:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff919059e3e900) 00010000:00010000:3.0:1785787689.225617:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787689.225621:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e8508d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.225626:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e8508d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.225636:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e85094 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x7c34ed66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.225641:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e85094 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x7c34ed66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.225646:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e85094 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x7c34ed66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.225651:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903200 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787689.225653:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e85094 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x7c34ed66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.225667:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e85094 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x7c34ed66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.225673:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x7c34ed66 (ffff919055acdd00) 00010000:00010000:3.0:1785787689.225676:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787689.225678:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e85094 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x7c34ed66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.225684:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e85094 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x7c34ed66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787689.225758:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190776f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+32:11548:x1872533744859136:12345-192.168.203.53@tcp:36:lhsmtool_posix.0 Request processed in 589us (799us total) trans 0 rc -2/-2 00000100:00100000:3.0:1785787689.225765:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 176 00000100:00100000:1.0:1785787689.232437:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787689.232866:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744859264 00000100:00100000:3.0:1785787689.232876:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744859264 00000100:00100000:3.0:1785787689.232932:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 177 00000100:00100000:3.0:1785787689.232942:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+32:11548:x1872533744859264:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785787689.232962:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787689.232984:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e8509b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd5bd expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.233016:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e850a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.233028:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e850a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.233047:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e850a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.233139:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e8509b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5bd expref: 34 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.233156:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e850a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5bd expref: 33 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.233165:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff919055acdc00) 00010000:00010000:3.0:1785787689.233168:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1785787689.233171:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f903a00, rc 0) 00000100:00100000:3.0:1785787689.233227:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+33:11548:x1872533744859264:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 286us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787689.233234:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 177 00000100:00100000:2.0:1785787689.263322:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787689.263618:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744859520 00000100:00100000:3.0:1785787689.263628:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744859520 00000100:00100000:3.0:1785787689.263688:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 178 00000100:00100000:3.0:1785787689.263697:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bc1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+33:11548:x1872533744859520:12345-192.168.203.53@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1785787689.263773:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e850a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.263788:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e850a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.263800:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e850a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785787689.265120:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:2.0:1785787689.265131:0:5822:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 476509302822ns, next at 477509300636ns, rc = 0 00000004:00010000:2.0:1785787689.265224:0:5822:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e98bfb66 reply state 000000000b0ffe72 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e850a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787689.265244:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785787689.265350:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bc1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+35:11548:x1872533744859520:12345-192.168.203.53@tcp:36:lhsmtool_posix.0 Request processed in 1652us (2036us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1785787689.265357:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 178 00000100:00100000:1.0:1785787689.271649:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787689.271679:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744859648 00000100:00100000:1.0:1785787689.271688:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744859648 00000100:00100000:1.0:1785787689.271735:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 179 00000100:00100000:1.0:1785787689.271744:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+35:11548:x1872533744859648:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1785787689.271764:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787689.271783:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e850b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd5c4 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.271856:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e850b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5c4 expref: 36 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.271870:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e850b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5c4 expref: 36 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.271896:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff919055acdc00) 00010000:00010000:1.0:1785787689.271900:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1785787689.271904:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91908206ae00, rc 0) 00000100:00100000:1.0:1785787689.271948:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+36:11548:x1872533744859648:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 205us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787689.271954:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 179 00010000:00010000:2.0:1785787689.275387:0:3320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e850a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787689.275403:0:3320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e850a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787689.275411:0:3320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e850a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787689.275418:0:3320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f902800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787689.275423:0:3320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e850a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787689.275440:0:3320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e850a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787689.275456:0:3320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff919055acdc00) 00010000:00010000:2.0:1785787689.275459:0:3320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1785787689.275464:0:3320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e850a9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787689.275469:0:3320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e850a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787689.276397:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787689.277401:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744859776 00000100:00100000:2.0:1785787689.277410:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744859776 00000100:00100000:2.0:1785787689.277484:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 51 00000100:00100000:2.0:1785787689.277494:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:79280304-55c6-4698-bfc3-29d14648ba45+6:2391:x1872533744859776:12345-192.168.203.53@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1785787689.277781:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:79280304-55c6-4698-bfc3-29d14648ba45+7:2391:x1872533744859776:12345-192.168.203.53@tcp:2:lhsmtool_posix.0 Request processed in 289us (1388us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1785787689.277788:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 51 00000100:00080000:1.0:1785787689.278062:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785787689.298919:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787689.298995:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744860032 00000100:00100000:0.0:1785787689.299005:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744860032 00000100:00100000:0.0:1785787689.299065:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 49 00000100:00100000:0.0:1785787689.299075:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+35:11548:x1872533744860032:12345-192.168.203.53@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1785787689.299279:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+36:11548:x1872533744860032:12345-192.168.203.53@tcp:35:lhsmtool_posix.0 Request processed in 206us (367us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1785787689.299287:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 49 00000100:00100000:2.0:1785787689.314920:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787689.318614:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744860288 00000100:00100000:3.0:1785787689.318628:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744860288 00000100:00100000:3.0:1785787689.318701:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 180 00000100:00100000:3.0:1785787689.318711:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bc1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+36:11548:x1872533744860288:12345-192.168.203.53@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1785787689.318844:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bc1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+36:11548:x1872533744860288:12345-192.168.203.53@tcp:57:lhsmtool_posix.0 Request processed in 120us (3917us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787689.318852:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 180 00000100:00100000:1.0:1785787689.326155:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787689.326189:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744860416 00000100:00100000:1.0:1785787689.326197:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744860416 00000100:00100000:1.0:1785787689.328981:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 181 00000100:00100000:1.0:1785787689.328998:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+36:11548:x1872533744860416:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1785787689.329017:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787689.329034:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91908206bc00/0xe2c2ff68a6e850b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd5cb expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.329953:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e850be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.329967:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e850be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.329978:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e850be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785787689.330020:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1785787689.330036:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e850be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.330122:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91908206bc00/0xe2c2ff68a6e850b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5cb expref: 38 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.330138:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e850be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5cb expref: 37 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.330148:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff919055acdc00) 00010000:00010000:1.0:1785787689.330151:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1785787689.330154:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91908206a400, rc 0) 00000100:00100000:1.0:1785787689.331132:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+37:11548:x1872533744860416:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 2135us (4981us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787689.331142:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 181 00000040:00080000:0.0:1785787689.338543:0:12393:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1785787689.338551:0:12393:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1785787689.338598:0:12393:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1785787689.338603:0:12393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1785787689.343946:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787689.344017:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744860544 00000100:00100000:3.0:1785787689.344026:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744860544 00000100:00100000:3.0:1785787689.344090:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 52 00000100:00100000:3.0:1785787689.344099:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190776f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:79280304-55c6-4698-bfc3-29d14648ba45+7:2390:x1872533744860544:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785787689.344117:0:6619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787689.344134:0:6619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b3a3c20/0xe2c2ff68a6e850c5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd5d2 expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785787689.344158:0:6619:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a70f529, blocks: 0x1 00010000:00010000:3.0:1785787689.344176:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1785787689.344180:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785787689.344188:0:6619:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b3a3c20/0xe2c2ff68a6e850c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5d2 expref: 8 pid: 6619 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.344205:0:6619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000b3a3c20/0xe2c2ff68a6e850c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5d2 expref: 8 pid: 6619 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.344218:0:6619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f903200, rc 0) 00000100:00100000:3.0:1785787689.344260:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190776f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:79280304-55c6-4698-bfc3-29d14648ba45+8:2390:x1872533744860544:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 162us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787689.344267:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 52 00000100:00100000:3.0:1785787689.356623:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787689.357590:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744860800 00000100:00100000:0.0:1785787689.357600:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744860800 00000100:00100000:0.0:1785787689.357668:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 182 00000100:00100000:0.0:1785787689.357677:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+37:11548:x1872533744860800:12345-192.168.203.53@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1785787689.357768:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+37:11548:x1872533744860800:12345-192.168.203.53@tcp:57:lhsmtool_posix.0 Request processed in 92us (1152us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787689.357775:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 182 00000100:00100000:2.0:1785787689.366564:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787689.368704:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744860928 00000100:00100000:3.0:1785787689.368716:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744860928 00000100:00100000:3.0:1785787689.368778:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 53 00000100:00100000:3.0:1785787689.368787:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bc18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:79280304-55c6-4698-bfc3-29d14648ba45+8:11548:x1872533744860928:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785787689.368804:0:9394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787689.368821:0:9394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c693aad9/0xe2c2ff68a6e850cc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd5d9 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.368873:0:9394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000b3a3c20/0xe2c2ff68a6e850c5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5d2 expref: 9 pid: 6619 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.368882:0:9394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785787689.368886:0:9394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785787689.368891:0:9394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c693aad9/0xe2c2ff68a6e850cc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5d9 expref: 9 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.368922:0:9394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000b3a3c20/0xe2c2ff68a6e850c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5d2 expref: 9 pid: 6619 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.368935:0:9394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000b3a3c20/0xe2c2ff68a6e850c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5d2 expref: 9 pid: 6619 timeout: 576 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787689.368948:0:9394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907be0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9394:1872533770029184:192.168.203.53@tcp:104: 00000100:00100000:3.0:1785787689.369039:0:9394:0:(client.c:2702:ptlrpc_set_wait()) set ffff91907fdff0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785787689.372628:0:9394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907be0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9394:1872533770029184:192.168.203.53@tcp:104: 00010000:00010000:3.0:1785787689.372668:0:9394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c693aad9/0xe2c2ff68a6e850cc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5d9 expref: 9 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.372688:0:9394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f902600, rc 0) 00000100:00100000:3.0:1785787689.372739:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bc18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:79280304-55c6-4698-bfc3-29d14648ba45+9:11548:x1872533744860928:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 3953us (6182us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787689.372748:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 53 00000100:00100000:2.0:1785787689.380139:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787689.382363:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744861056 00000100:00100000:1.0:1785787689.382376:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744861056 00010000:00010000:1.0:1785787689.382418:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000b3a3c20/0xe2c2ff68a6e850c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5d2 expref: 9 pid: 6619 timeout: 576 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787689.382468:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 67 00000100:00100000:1.0:1785787689.382477:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051466c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79280304-55c6-4698-bfc3-29d14648ba45+9:2391:x1872533744861056:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785787689.382492:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785787689.382513:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000b3a3c20/0xe2c2ff68a6e850c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5d2 expref: 9 pid: 6619 timeout: 576 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.382544:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000b3a3c20/0xe2c2ff68a6e850c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5d2 expref: 9 pid: 6619 timeout: 576 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.382566:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b3a3c20/0xe2c2ff68a6e850c5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5d2 expref: 9 pid: 6619 timeout: 576 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.382582:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785787689.382587:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785787689.382596:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c693aad9/0xe2c2ff68a6e850cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5d9 expref: 8 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.382607:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c693aad9/0xe2c2ff68a6e850cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5d9 expref: 8 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.382644:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c693aad9/0xe2c2ff68a6e850cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5d9 expref: 8 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787689.382656:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b377800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5806:1872533770029312:192.168.203.53@tcp:105: 00000100:00100000:1.0:1785787689.382773:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff91907fe40000 going to sleep for 11 seconds 00000100:00100000:1.0:1785787689.400089:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787689.400330:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b377800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5806:1872533770029312:192.168.203.53@tcp:105: 00010000:00010000:0.0:1785787689.400352:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785787689.400409:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051466c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79280304-55c6-4698-bfc3-29d14648ba45+8:2391:x1872533744861056:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 17932us (20277us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787689.400419:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 67 00000100:00100000:2.0:1785787689.401955:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744861184 00000100:00100000:2.0:1785787689.401964:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744861184 00002000:00100000:0.0:1785787689.419411:0:6624:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff919076edfb80 x1872533744861184/t0(0) o4->79280304-55c6-4698-bfc3-29d14648ba45@192.168.203.53@tcp:545/0 lens 504/0 e 0 to 0 dl 1785787700 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785787689.419434:0:6624:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff919076edfb80 with x1872533744861184 ext(0->8) 00002000:00010000:0.0:1785787689.419441:0:6624:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff919076edfb80 00000100:00100000:0.0:1785787689.419474:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 4 00000100:00100000:0.0:1785787689.419484:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076edfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:79280304-55c6-4698-bfc3-29d14648ba45+8:2390:x1872533744861184:12345-192.168.203.53@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1785787689.419884:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076edfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:79280304-55c6-4698-bfc3-29d14648ba45+10:2390:x1872533744861184:12345-192.168.203.53@tcp:4:lhsmtool_posix.0 Request processed in 400us (19800us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1785787689.419892:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 4 00002000:00100000:0.0:1785787689.419899:0:6624:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff919076edfb80 x1872533744861184/t4294967314(0) o4->79280304-55c6-4698-bfc3-29d14648ba45@192.168.203.53@tcp:545/0 lens 504/448 e 0 to 0 dl 1785787700 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785787689.419906:0:6624:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff919076edfb80 with x1872533744861184 ext(0->8) 00002000:00010000:0.0:1785787689.419910:0:6624:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff919076edfb80 00000100:00100000:0.0:1785787689.444797:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787689.451592:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744861312 00000100:00100000:2.0:1785787689.451608:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744861312 00000100:00100000:2.0:1785787689.451672:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 183 00000100:00100000:2.0:1785787689.451682:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190776f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+37:11548:x1872533744861312:12345-192.168.203.53@tcp:44:lhsmtool_posix.0 00010000:00010000:1.0:1785787689.464576:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785787689.535404:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190776f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+37:11548:x1872533744861312:12345-192.168.203.53@tcp:44:lhsmtool_posix.0 Request processed in 83714us (90604us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787689.535416:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 183 00000001:00080000:2.0:1785787689.535459:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:2.0:1785787689.535476:0:5843:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:2.0:1785787689.535508:0:5843:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:0.0:1785787689.535895:0:5854:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1785787689.535908:0:5854:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1785787689.536023:0:3334:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785787689.541905:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190776f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770029440:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1785787689.541970:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787689.542071:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770029440 00000100:00100000:1.0:1785787689.542079:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770029440 00000100:00100000:1.0:1785787689.542137:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1785787689.542146:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770029440:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1785787689.542309:0:6619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1785787689.542313:0:6619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1785787689 00002000:00010000:1.0:1785787689.542316:0:6619:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1785787689.542318:0:6619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1785787689 -> 1785787689 00002000:00010000:1.0:1785787689.542321:0:6619:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1785787689.542359:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3334:x1872533770029440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 214us (389us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1785787689.542366:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:1.0:1785787689.542405:0:3334:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9190776f2d80/2, rc 0, transno 4294967315 00000100:00100000:1.0:1785787689.542410:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190776f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770029440:0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1785787689.542453:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785787689.542823:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787689.557441:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744861440 00000100:00100000:3.0:1785787689.557456:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744861440 00000100:00100000:3.0:1785787689.557509:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 55 00000100:00100000:3.0:1785787689.557518:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:79280304-55c6-4698-bfc3-29d14648ba45+10:2388:x1872533744861440:12345-192.168.203.53@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1785787689.621856:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000001:00080000:3.0:1785787689.621876:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:3.0:1785787689.621962:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:79280304-55c6-4698-bfc3-29d14648ba45+7:2388:x1872533744861440:12345-192.168.203.53@tcp:16:lhsmtool_posix.0 Request processed in 64439us (79135us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787689.621973:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 55 00000100:00100000:2.0:1785787689.624808:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787689.624997:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744861696 00000100:00100000:0.0:1785787689.625005:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744861696 00000100:00100000:0.0:1785787689.625057:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 184 00000100:00100000:0.0:1785787689.625066:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bc1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+18:11548:x1872533744861696:12345-192.168.203.53@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1785787689.625113:0:9295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785787689.625146:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e850be lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5cb expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.625161:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff919055acdc00) 00010000:00010000:0.0:1785787689.625176:0:9295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785787689.625203:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e850d3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.625215:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e850d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.625224:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e850d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785787689.625456:0:9295:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000044954f reply state 000000001944525e transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e850d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787689.625466:0:9295:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785787689.625587:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bc1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+19:11548:x1872533744861696:12345-192.168.203.53@tcp:36:lhsmtool_posix.0 Request processed in 514us (777us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1785787689.625595:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 184 00000100:00100000:0.0:1785787689.628379:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787689.628759:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744861824 00000100:00100000:1.0:1785787689.628767:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744861824 00000100:00100000:1.0:1785787689.628888:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 56 00000100:00100000:1.0:1785787689.628898:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190776f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:79280304-55c6-4698-bfc3-29d14648ba45+7:2390:x1872533744861824:12345-192.168.203.53@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1785787689.629095:0:6619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1785787689.629099:0:6619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1785787689 -> 1785787688 00002000:00010000:1.0:1785787689.629102:0:6619:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1785787686 00002000:00010000:1.0:1785787689.629104:0:6619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1785787689 -> 1785787688 00002000:00010000:1.0:1785787689.629107:0:6619:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1785787689.629150:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190776f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:79280304-55c6-4698-bfc3-29d14648ba45+8:2390:x1872533744861824:12345-192.168.203.53@tcp:2:lhsmtool_posix.0 Request processed in 253us (776us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1785787689.629157:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 56 00010000:00010000:2.0:1785787689.629331:0:3319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e850d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787689.629341:0:3319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e850d3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787689.629348:0:3319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e850d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787689.629365:0:3319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919052f5f800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787689.629371:0:3319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e850d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787689.629378:0:3319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e850d3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787689.629392:0:3319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff919055acdc00) 00010000:00010000:2.0:1785787689.629395:0:3319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787689.629399:0:3319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e850d3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787689.629404:0:3319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e850d3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787689.631359:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787689.631419:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744862080 00000100:00100000:1.0:1785787689.631437:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744862080 00000100:00100000:1.0:1785787689.631519:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 185 00000100:00100000:1.0:1785787689.631528:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190776f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+18:11548:x1872533744862080:12345-192.168.203.53@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1785787689.631600:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206bc00/0xe2c2ff68a6e850da lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.631616:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e850a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5bd expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.631625:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91908206bc00/0xe2c2ff68a6e850da lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.631657:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e850a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5bd expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.631671:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e850a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5bd expref: 18 pid: 5821 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787689.631685:0:5821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076edf100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5821:1872533770029568:192.168.203.53@tcp:104: 00000100:00100000:1.0:1785787689.631765:0:5821:0:(client.c:2702:ptlrpc_set_wait()) set ffff91907fe403c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785787689.633990:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787689.634041:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744862208 00000100:00100000:3.0:1785787689.634048:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744862208 00010000:00010000:3.0:1785787689.634079:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e850a2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5bd expref: 19 pid: 5821 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787689.634112:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 68 00000100:00100000:3.0:1785787689.634121:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bc1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79280304-55c6-4698-bfc3-29d14648ba45+19:2391:x1872533744862208:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785787689.634144:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787689.634151:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e850a2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5bd expref: 19 pid: 5821 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.634172:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e850a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5bd expref: 19 pid: 5821 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.634194:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff919055acdc00) 00010000:00010000:3.0:1785787689.634199:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91908206bc00/0xe2c2ff68a6e850da lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.634207:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91908206bc00/0xe2c2ff68a6e850da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.634214:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91908206bc00/0xe2c2ff68a6e850da lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.634230:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787689.634275:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bc1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79280304-55c6-4698-bfc3-29d14648ba45+19:2391:x1872533744862208:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 154us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787689.634283:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 68 00010000:00010000:1.0:1785787689.635403:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e850a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5bd expref: 18 pid: 5821 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787689.635430:0:5821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076edf100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5821:1872533770029568:192.168.203.53@tcp:104: 00010000:00010000:1.0:1785787689.635449:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91908206bc00/0xe2c2ff68a6e850da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787689.635517:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91908206bc00/0xe2c2ff68a6e850da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787689.635524:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91908206bc00/0xe2c2ff68a6e850da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787689.635550:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206bc00/0xe2c2ff68a6e850da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787689.635557:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91908206bc00/0xe2c2ff68a6e850da lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787689.635563:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91908206bc00/0xe2c2ff68a6e850da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787689.635625:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91908206bc00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787689.635630:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91908206bc00/0xe2c2ff68a6e850da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787689.635637:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91908206bc00/0xe2c2ff68a6e850da lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787689.635647:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff919055acdc00) 00010000:00010000:2.0:1785787689.635650:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1785787689.635654:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91908206bc00/0xe2c2ff68a6e850da lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787689.635659:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91908206bc00/0xe2c2ff68a6e850da lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787689.635741:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190776f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+17:11548:x1872533744862080:12345-192.168.203.53@tcp:55:lhsmtool_posix.0 Request processed in 4213us (4449us total) trans 0 rc -22/-22 00000100:00100000:2.0:1785787689.635749:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 185 00000100:00100000:2.0:1785787689.640279:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787689.640354:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744862336 00000100:00100000:3.0:1785787689.640363:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744862336 00000100:00100000:3.0:1785787689.640415:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 57 00000100:00100000:3.0:1785787689.640434:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bc18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:79280304-55c6-4698-bfc3-29d14648ba45+8:2388:x1872533744862336:12345-192.168.203.53@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1785787689.640482:0:9394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000051f52044/0xe2c2ff68a6e850e1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.640501:0:9394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c693aad9/0xe2c2ff68a6e850cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5d9 expref: 8 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.640521:0:9394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785787689.640525:0:9394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1785787689.640530:0:9394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051f52044/0xe2c2ff68a6e850e1 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.640563:0:9394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c693aad9/0xe2c2ff68a6e850cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5d9 expref: 8 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.640577:0:9394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c693aad9/0xe2c2ff68a6e850cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5d9 expref: 8 pid: 9394 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787689.640591:0:9394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907be0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9394:1872533770029696:192.168.203.53@tcp:104: 00000100:00100000:3.0:1785787689.640652:0:9394:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190809c7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1785787689.642999:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787689.643057:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744862464 00000100:00100000:2.0:1785787689.643065:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744862464 00010000:00010000:2.0:1785787689.643094:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c693aad9/0xe2c2ff68a6e850cc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5d9 expref: 9 pid: 9394 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787689.643131:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 69 00000100:00100000:2.0:1785787689.643139:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190776f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79280304-55c6-4698-bfc3-29d14648ba45+9:2391:x1872533744862464:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785787689.643151:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785787689.643180:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c693aad9/0xe2c2ff68a6e850cc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5d9 expref: 9 pid: 9394 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787689.643202:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c693aad9/0xe2c2ff68a6e850cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5d9 expref: 9 pid: 9394 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787689.643223:0:5805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785787689.643227:0:5805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785787689.643233:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000051f52044/0xe2c2ff68a6e850e1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787689.643242:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051f52044/0xe2c2ff68a6e850e1 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787689.643257:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785787689.643306:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190776f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79280304-55c6-4698-bfc3-29d14648ba45+9:2391:x1872533744862464:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 167us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787689.643313:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 69 00010000:00010000:3.0:1785787689.644138:0:9394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c693aad9/0xe2c2ff68a6e850cc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5d9 expref: 8 pid: 9394 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787689.644154:0:9394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907be0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9394:1872533770029696:192.168.203.53@tcp:104: 00010000:00010000:3.0:1785787689.644188:0:9394:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000051f52044/0xe2c2ff68a6e850e1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.644198:0:9394:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000051f52044/0xe2c2ff68a6e850e1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.644206:0:9394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051f52044/0xe2c2ff68a6e850e1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.644242:0:9394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000051f52044/0xe2c2ff68a6e850e1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.644250:0:9394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051f52044/0xe2c2ff68a6e850e1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.644258:0:9394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051f52044/0xe2c2ff68a6e850e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.644264:0:9394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903000 already unused, calling callback (ffffffffc174c300) 00010000:00010000:3.0:1785787689.644268:0:9394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051f52044/0xe2c2ff68a6e850e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.644276:0:9394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051f52044/0xe2c2ff68a6e850e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.644299:0:9394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051f52044/0xe2c2ff68a6e850e1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.644308:0:9394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051f52044/0xe2c2ff68a6e850e1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787689.644371:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bc18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:79280304-55c6-4698-bfc3-29d14648ba45+7:2388:x1872533744862336:12345-192.168.203.53@tcp:1:lhsmtool_posix.0 Request processed in 3946us (4099us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787689.644380:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 57 00000100:00100000:0.0:1785787689.646476:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787689.646535:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744862720 00000100:00100000:3.0:1785787689.646543:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744862720 00000100:00100000:3.0:1785787689.646595:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 186 00000100:00100000:3.0:1785787689.646603:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+17:11548:x1872533744862720:12345-192.168.203.53@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1785787689.646670:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e850e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.646685:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e850e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.646695:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e850e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.646958:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e850ef lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.646970:0:9295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e850b0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5c4 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.646978:0:9295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e850ef lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.647007:0:9295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e850b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5c4 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.647020:0:9295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e850b0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5c4 expref: 18 pid: 5821 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787689.647033:0:9295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907be0ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9295:1872533770029824:192.168.203.53@tcp:104: 00000100:00100000:3.0:1785787689.647130:0:9295:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190809c7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1785787689.650365:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787689.650771:0:11051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744862848 00000100:00100000:2.0:1785787689.650780:0:11051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744862848 00010000:00010000:2.0:1785787689.650816:0:11051:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e850b0 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5c4 expref: 19 pid: 5821 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787689.650876:0:11051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 70 00000100:00100000:2.0:1785787689.650886:0:11051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076edf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79280304-55c6-4698-bfc3-29d14648ba45+19:2391:x1872533744862848:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785787689.650899:0:11051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785787689.650906:0:11051:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e850b0 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5c4 expref: 19 pid: 5821 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787689.650936:0:11051:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e850b0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5c4 expref: 19 pid: 5821 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787689.650957:0:11051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff919055acdc00) 00010000:00010000:2.0:1785787689.650963:0:11051:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e850ef lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787689.650972:0:11051:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e850ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787689.650980:0:11051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e850ef lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787689.650996:0:11051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785787689.651040:0:11051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076edf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79280304-55c6-4698-bfc3-29d14648ba45+19:2391:x1872533744862848:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 155us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787689.651047:0:11051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 70 00010000:00010000:3.0:1785787689.651959:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e850b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5c4 expref: 18 pid: 5821 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787689.651977:0:9295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907be0ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9295:1872533770029824:192.168.203.53@tcp:104: 00010000:00010000:3.0:1785787689.651999:0:9295:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e850ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.652095:0:9295:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e850ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.652103:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e850ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785787689.652386:0:9295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1785787689.652523:0:9295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1785787689.652561:0:9295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1785787689.652695:0:9295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bb62a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9295:1872533770029952:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1785787689.652740:0:9295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787689.652801:0:9295:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190770ab840 going to sleep for 11 seconds 00000100:00100000:2.0:1785787689.653050:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770029952 00000100:00100000:2.0:1785787689.653056:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770029952 00000100:00100000:2.0:1785787689.653123:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1785787689.653131:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9295:x1872533770029952:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1785787689.653237:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9295:x1872533770029952:12345-0@lo:1000:mdt00_003.0 Request processed in 107us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787689.653244:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1785787689.653384:0:9295:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1785787689.653389:0:9295:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9190776f2d80, transno 4294967315 00000100:00100000:0.0:1785787689.653408:0:9295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bb62a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9295:1872533770029952:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1785787689.653801:0:9295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1785787689.653946:0:9295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bb62a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9295:1872533770030080:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1785787689.653973:0:9295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787689.654023:0:9295:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190770ab3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785787689.654405:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770030080 00000100:00100000:2.0:1785787689.654410:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770030080 00000100:00100000:2.0:1785787689.654441:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1785787689.654448:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9295:x1872533770030080:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1785787689.654778:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9295:x1872533770030080:12345-0@lo:1000:mdt00_003.0 Request processed in 329us (803us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1785787689.654786:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1785787689.654966:0:9295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bb62a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9295:1872533770030080:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1785787689.654993:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e850ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.655003:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e850ef lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.655010:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e850ef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.655016:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903200 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1785787689.655020:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e850ef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.655027:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e850ef lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.655048:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff919055acdc00) 00010000:00010000:0.0:1785787689.655051:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1785787689.655055:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e850ef lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.655062:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e850ef lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.655086:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e8502b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.655092:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e8502b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.655097:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e8502b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.655102:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0fa00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1785787689.655104:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e8502b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.655109:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e8502b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.655116:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91905685f300) 00010000:00010000:0.0:1785787689.655118:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1785787689.655121:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e8502b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.655126:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0fa00/0xe2c2ff68a6e8502b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.655151:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e850f6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.655222:0:9295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e85047 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5a8 expref: 21 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.655232:0:9295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e850f6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.655260:0:9295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e85047 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5a8 expref: 21 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.655273:0:9295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e85047 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5a8 expref: 21 pid: 9295 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787689.655285:0:9295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905c5f8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9295:1872533770030208:192.168.203.53@tcp:104: 00000100:00100000:0.0:1785787689.655735:0:9295:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190770ab3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785787689.658547:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787689.658615:0:9295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905c5f8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9295:1872533770030208:192.168.203.53@tcp:104: 00010000:00010000:0.0:1785787689.658636:0:9295:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e850f6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787689.658683:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744862976 00000100:00100000:3.0:1785787689.658689:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744862976 00010000:00010000:3.0:1785787689.658718:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e85047 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5a8 expref: 22 pid: 9295 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787689.658750:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 71 00000100:00100000:3.0:1785787689.658758:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bc18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79280304-55c6-4698-bfc3-29d14648ba45+22:2391:x1872533744862976:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785787689.658769:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787689.658776:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e85047 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5a8 expref: 22 pid: 9295 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.658786:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e85047 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5a8 expref: 22 pid: 9295 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.658804:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e85047 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5a8 expref: 22 pid: 9295 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.658818:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91905685f300) 00010000:00010000:3.0:1785787689.658823:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e850f6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.658869:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e850f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.658877:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e850f6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787689.658894:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785787689.658971:0:9295:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e850f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.658978:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e850f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.658988:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e850f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.659000:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e850f6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.659006:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e850f6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.659012:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919052f5e400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1785787689.659016:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e850f6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.659022:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e850f6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.659031:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91905685f300) 00010000:00010000:0.0:1785787689.659033:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785787689.659037:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e850f6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.659042:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e850f6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.659052:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e850e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.659057:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e850e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.659062:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e850e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.659067:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1785787689.659074:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e850e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.659079:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e850e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.659086:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91905685f300) 00010000:00010000:0.0:1785787689.659088:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1785787689.659103:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e850e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.659109:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e850e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787689.659698:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bc18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79280304-55c6-4698-bfc3-29d14648ba45+21:2391:x1872533744862976:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 938us (1156us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787689.659707:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 71 00000100:00100000:0.0:1785787689.659778:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+20:11548:x1872533744862720:12345-192.168.203.53@tcp:57:lhsmtool_posix.0 Request processed in 13176us (13308us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1785787689.659787:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 186 00000020:00080000:0.0:1785787689.659791:0:9295:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1785787689.659915:0:11564:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1785787689.659919:0:11564:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1785787689.660488:0:11564:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1785787689.660497:0:11564:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1785787689.663309:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787689.663403:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744863232 00000100:00100000:0.0:1785787689.663411:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744863232 00000100:00100000:0.0:1785787689.663473:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 50 00000100:00100000:0.0:1785787689.663482:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190451bf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+20:11548:x1872533744863232:12345-192.168.203.53@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1785787689.664070:0:5823:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1785787689.664343:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1785787689.664382:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e850fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.664407:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e850fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.664418:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e850fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.664438:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e850fd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.664444:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e850fd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.664450:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e850fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787689.664469:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1785787689.664534:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190451bf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+22:11548:x1872533744863232:12345-192.168.203.53@tcp:35:lhsmtool_posix.0 Request processed in 1052us (1231us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1785787689.664541:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 50 00000020:00080000:0.0:1785787689.664545:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1785787689.664738:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785787689.664744:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e850fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.664757:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919052f5f800 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785787689.664761:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e850fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.664768:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e850fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.664779:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff919059e3e000) 00010000:00010000:1.0:1785787689.664782:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785787689.664786:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e850fd lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.664791:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e850fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787689.664805:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787689.664807:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787689.664808:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787690.492327:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785787690.630655:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787690.635303:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787690.635333:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787690.635364:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787690.639542:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744863360 00000100:00100000:0.0:1785787690.639554:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744863360 00000100:00100000:0.0:1785787690.639610:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 311 00000100:00100000:0.0:1785787690.639618:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2390:x1872533744863360:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1785787690.639693:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2390:x1872533744863360:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 75us (4400us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787690.639700:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 311 00000100:00100000:0.0:1785787690.639761:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744863616 00000100:00100000:0.0:1785787690.639774:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744863616 00000100:00100000:0.0:1785787690.639810:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 107 00000100:00100000:0.0:1785787690.639816:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+5:2390:x1872533744863616:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1785787690.639860:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+5:2390:x1872533744863616:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 44us (4526us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787690.639866:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 107 00000100:00080000:0.0:1785787690.639880:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785787690.653252:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787690.653298:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744863744 00000100:00100000:1.0:1785787690.653307:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744863744 00000100:00100000:1.0:1785787690.653356:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 108 00000100:00100000:1.0:1785787690.653371:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190776f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:79280304-55c6-4698-bfc3-29d14648ba45+7:2391:x1872533744863744:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1785787690.653458:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190776f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:79280304-55c6-4698-bfc3-29d14648ba45+7:2391:x1872533744863744:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 88us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787690.653476:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 108 00000100:00100000:2.0:1785787690.659540:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744863488 00000100:00100000:2.0:1785787690.659554:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744863488 00000100:00100000:2.0:1785787690.672555:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744863872 00000100:00100000:2.0:1785787690.672565:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744863872 00000100:00100000:2.0:1785787690.672608:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 184 00000100:00100000:2.0:1785787690.672618:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+22:2391:x1872533744863488:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:2.0:1785787690.672698:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+22:2391:x1872533744863488:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 81us (42050us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787690.672705:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 184 00000100:00100000:2.0:1785787690.672724:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 185 00000100:00100000:2.0:1785787690.672730:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ede300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4ec65b7-e63e-42dc-becf-cba362002085+5:2390:x1872533744863872:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:2.0:1785787690.672755:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ede300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4ec65b7-e63e-42dc-becf-cba362002085+5:2390:x1872533744863872:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 25us (37391us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787690.672761:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 185 00000100:00080000:2.0:1785787690.672909:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1785787690.676364:0:11564:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1785787690.676371:0:11564:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1785787690.676403:0:11564:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1785787690.676409:0:11564:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1785787690.933368:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bc18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770030720:0@lo:400:kworker.0 00000100:00100000:2.0:1785787690.933536:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787690.933591:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1785787690.933598:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bc1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533770030336:0@lo:400:kworker.0 00000100:00100000:2.0:1785787690.933626:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787690.933648:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bc1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3333:1872533770030848:0@lo:400:kworker.0 00000100:00100000:2.0:1785787690.933681:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787690.933707:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bc18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3336:1872533770030592:0@lo:400:kworker.0 00000100:00100000:2.0:1785787690.933729:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787690.933747:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1785787690.933752:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bc19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3336:1872533770030464:0@lo:400:kworker.0 00000100:00100000:2.0:1785787690.933772:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787690.933787:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bc19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770030976:0@lo:400:kworker.0 00000100:00100000:2.0:1785787690.933808:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787690.933854:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770030720 00000100:00100000:2.0:1785787690.933861:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770030720 00000100:00100000:2.0:1785787690.933909:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770030976 00000100:00100000:2.0:1785787690.933912:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770030976 00000100:00100000:2.0:1785787690.933934:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1785787690.933942:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bc18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770030720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787690.933988:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bc18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770030720:12345-0@lo:400:kworker.0 Request processed in 46us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787690.933995:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1785787690.934010:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1785787690.934016:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3336:x1872533770030976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787690.934045:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3336:x1872533770030976:12345-0@lo:400:kworker.0 Request processed in 29us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787690.934051:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1785787690.934068:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770030848 00000100:00100000:2.0:1785787690.934071:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770030848 00000100:00100000:2.0:1785787690.934093:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770030592 00000100:00100000:2.0:1785787690.934096:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770030592 00000100:00100000:2.0:1785787690.934107:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770030464 00000100:00100000:2.0:1785787690.934115:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770030464 00000100:00100000:2.0:1785787690.934130:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1785787690.934135:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bc1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1872533770030848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787690.934163:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bc1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1872533770030848:12345-0@lo:400:kworker.0 Request processed in 28us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787690.934169:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1785787690.934181:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1785787690.934186:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3336:x1872533770030592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787690.934211:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3336:x1872533770030592:12345-0@lo:400:kworker.0 Request processed in 25us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787690.934217:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1785787690.934228:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1785787690.934233:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3336:x1872533770030464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787690.934257:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3336:x1872533770030464:12345-0@lo:400:kworker.0 Request processed in 24us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787690.934262:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1785787690.934490:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770030336 00000100:00100000:3.0:1785787690.934495:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770030336 00000100:00100000:3.0:1785787690.934523:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1785787690.934529:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+19:3333:x1872533770030336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787690.934564:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+19:3333:x1872533770030336:12345-0@lo:400:kworker.0 Request processed in 35us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787690.934570:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00080000:2.0:1785787690.935089:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1785787690.935094:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785787690.935132:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bc19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3336:1872533770030464:0@lo:400:kworker.0 00000100:00100000:2.0:1785787690.935144:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bc19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770030976:0@lo:400:kworker.0 00000100:00100000:2.0:1785787690.935151:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bc18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3336:1872533770030592:0@lo:400:kworker.0 00000100:00100000:2.0:1785787690.935178:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bc1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533770030336:0@lo:400:kworker.0 00000100:00100000:2.0:1785787690.935187:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bc1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3333:1872533770030848:0@lo:400:kworker.0 00000100:00100000:2.0:1785787690.935195:0:3333:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:2.0:1785787690.935207:0:3333:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:2.0:1785787690.935224:0:3333:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91907be0df80, transno 4294967307 00000100:00100000:2.0:1785787690.935242:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bc18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770030720:0@lo:400:kworker.0 00000100:00100000:3.0:1785787691.443046:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785787691.443068:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905c5f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770031104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785787691.443131:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787691.443287:0:8140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770031104 00000100:00100000:0.0:1785787691.443295:0:8140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770031104 00000100:00100000:0.0:1785787691.443351:0:8140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1785787691.443361:0:8140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3335:x1872533770031104:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1785787691.443503:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1785787691.443540:0:8140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785787691.443592:0:8140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3335:x1872533770031104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 233us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787691.443599:0:8140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1785787691.443684:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905c5f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770031104:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1785787691.484640:0:12445:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1785787691.484648:0:12445:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1785787691.484694:0:12445:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1785787691.484700:0:12445:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1785787691.517478:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785787691.660872:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787691.661003:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744864128 00000100:00100000:3.0:1785787691.661013:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744864128 00000100:00100000:3.0:1785787691.661075:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 187 00000100:00100000:3.0:1785787691.661084:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bc18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+22:11566:x1872533744864128:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:3.0:1785787691.661111:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787691.661130:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e85104 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd5e0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1785787691.661344:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1785787691.661534:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e8510b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787691.661549:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e8510b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787691.661561:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e8510b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785787691.661572:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1785787691.661727:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e85104 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5e0 expref: 25 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787691.661743:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e8510b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5e0 expref: 24 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787691.661752:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff919059e3e900) 00010000:00010000:3.0:1785787691.661755:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1785787691.661758:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f902600, rc 0) 00000100:00100000:3.0:1785787691.661813:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bc18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+24:11566:x1872533744864128:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 730us (948us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1785787691.661820:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 187 00000100:00100000:3.0:1785787691.670079:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787691.670158:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744864256 00000100:00100000:1.0:1785787691.670167:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744864256 00000100:00100000:1.0:1785787691.670220:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 188 00000100:00100000:1.0:1785787691.670229:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+24:11566:x1872533744864256:12345-192.168.203.53@tcp:34:lfs.0 00010000:00010000:1.0:1785787691.670308:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b600/0xe2c2ff68a6e85119 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.670324:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b600/0xe2c2ff68a6e85119 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.670335:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b600/0xe2c2ff68a6e85119 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.670350:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b000/0xe2c2ff68a6e85120 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.670357:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b000/0xe2c2ff68a6e85120 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.670364:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b000/0xe2c2ff68a6e85120 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.670632:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a200/0xe2c2ff68a6e85127 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.670641:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a200/0xe2c2ff68a6e85127 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.670649:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a200/0xe2c2ff68a6e85127 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785787691.670694:0:9295:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a200/0xe2c2ff68a6e85127 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.670706:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b600/0xe2c2ff68a6e85119 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.670713:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b600/0xe2c2ff68a6e85119 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.670720:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b600/0xe2c2ff68a6e85119 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.670726:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91908206b600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787691.670730:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b600/0xe2c2ff68a6e85119 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.670738:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b600/0xe2c2ff68a6e85119 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.670749:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff919059e3e900) 00010000:00010000:1.0:1785787691.670752:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785787691.670756:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b600/0xe2c2ff68a6e85119 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.670763:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b600/0xe2c2ff68a6e85119 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.670773:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b000/0xe2c2ff68a6e85120 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.670779:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b000/0xe2c2ff68a6e85120 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.670790:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b000/0xe2c2ff68a6e85120 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.670796:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91908206b000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787691.670799:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b000/0xe2c2ff68a6e85120 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.670805:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b000/0xe2c2ff68a6e85120 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.670813:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91905685fc00) 00010000:00010000:1.0:1785787691.670816:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785787691.670819:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b000/0xe2c2ff68a6e85120 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.670845:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b000/0xe2c2ff68a6e85120 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.670861:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a200/0xe2c2ff68a6e85127 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.670868:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a200/0xe2c2ff68a6e85127 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.670874:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a200/0xe2c2ff68a6e85127 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.670879:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91908206a200 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787691.670882:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a200/0xe2c2ff68a6e85127 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.670898:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a200/0xe2c2ff68a6e85127 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.670906:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91905685f100) 00010000:00010000:1.0:1785787691.670908:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785787691.670911:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a200/0xe2c2ff68a6e85127 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.670917:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a200/0xe2c2ff68a6e85127 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787691.670986:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+24:11566:x1872533744864256:12345-192.168.203.53@tcp:34:lfs.0 Request processed in 757us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787691.670994:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 188 00000100:00100000:1.0:1785787691.733868:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787691.734581:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744864512 00000100:00100000:2.0:1785787691.734591:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744864512 00000100:00100000:2.0:1785787691.734647:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 189 00000100:00100000:2.0:1785787691.734656:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190776f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+24:11569:x1872533744864512:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:2.0:1785787691.734675:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787691.734694:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e8512e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd5e7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.734757:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e85135 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.734770:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e85135 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.734781:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e85135 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.734794:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e8513c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.734810:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e8513c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.734817:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e8513c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.735134:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e85143 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.735143:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e85143 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.735164:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e85143 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787691.735175:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1785787691.735256:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e85135 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.735263:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e85135 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.735269:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e85135 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.737233:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677c800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787691.737238:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e85135 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.737246:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e85135 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.737270:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff919059e3e900) 00010000:00010000:2.0:1785787691.737367:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787691.737373:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e85135 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.737380:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e85135 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.737451:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e8513c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.737457:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e8513c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.737463:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e8513c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.737467:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677ca00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787691.737470:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e8513c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.737475:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e8513c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.737483:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9190481f9c00) 00010000:00010000:2.0:1785787691.737486:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787691.737488:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e8513c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.737494:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ca00/0xe2c2ff68a6e8513c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.737552:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e8512e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5e7 expref: 27 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.737565:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e85143 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5e7 expref: 26 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.737572:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9190481f9100) 00010000:00010000:2.0:1785787691.737574:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785787691.737576:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677d000, rc 0) 00000100:00100000:2.0:1785787691.737681:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190776f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+26:11569:x1872533744864512:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 3025us (3854us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1785787691.737690:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 189 00000100:00100000:2.0:1785787691.758601:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787691.758703:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744864640 00000100:00100000:1.0:1785787691.758712:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744864640 00000100:00100000:1.0:1785787691.758764:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 190 00000100:00100000:1.0:1785787691.758773:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bc1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+26:11569:x1872533744864640:12345-192.168.203.53@tcp:54:lfs.0 00010000:00010000:1.0:1785787691.758853:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a200/0xe2c2ff68a6e85151 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.758868:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a200/0xe2c2ff68a6e85151 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.758881:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a200/0xe2c2ff68a6e85151 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.758905:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a200/0xe2c2ff68a6e85151 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.758917:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a200/0xe2c2ff68a6e85151 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.758924:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a200/0xe2c2ff68a6e85151 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.758930:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91908206a200 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787691.758934:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a200/0xe2c2ff68a6e85151 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.758941:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a200/0xe2c2ff68a6e85151 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.758952:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9190481f9100) 00010000:00010000:1.0:1785787691.758954:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785787691.758959:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a200/0xe2c2ff68a6e85151 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.758964:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a200/0xe2c2ff68a6e85151 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787691.759070:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bc1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+26:11569:x1872533744864640:12345-192.168.203.53@tcp:54:lfs.0 Request processed in 297us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787691.759078:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 190 00000100:00100000:0.0:1785787691.770585:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787691.770656:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744864896 00000100:00100000:1.0:1785787691.770666:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744864896 00000100:00100000:1.0:1785787691.770730:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 51 00000100:00100000:1.0:1785787691.770740:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905c5f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+26:11569:x1872533744864896:12345-192.168.203.53@tcp:35:lfs.0 00000100:00100000:1.0:1785787691.770962:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905c5f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+27:11569:x1872533744864896:12345-192.168.203.53@tcp:35:lfs.0 Request processed in 222us (382us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1785787691.770977:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 51 00000100:00100000:0.0:1785787691.820908:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787691.820984:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744865152 00000100:00100000:1.0:1785787691.820993:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744865152 00000100:00100000:1.0:1785787691.821048:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 191 00000100:00100000:1.0:1785787691.821057:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+27:11095:x1872533744865152:12345-192.168.203.53@tcp:101:bash.0 00010000:00010000:1.0:1785787691.821078:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787691.821099:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a200/0xe2c2ff68a6e85158 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd5ee expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.821186:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b600/0xe2c2ff68a6e8515f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.821200:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e85143 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5e7 expref: 28 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.821208:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b600/0xe2c2ff68a6e8515f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.821240:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e85143 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5e7 expref: 28 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787691.821253:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e85143 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5e7 expref: 28 pid: 5820 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787691.821265:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bd7ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5822:1872533770031232:192.168.203.53@tcp:104: 00000100:00100000:1.0:1785787691.821348:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff91907fe40b40 going to sleep for 11 seconds 00000100:00100000:1.0:1785787691.831331:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787691.834058:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bd7ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5822:1872533770031232:192.168.203.53@tcp:104: 00010000:00010000:3.0:1785787691.834152:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b600/0xe2c2ff68a6e8515f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787691.834888:0:11051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744865280 00000100:00100000:2.0:1785787691.834895:0:11051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744865280 00010000:00010000:0.0:1785787691.835298:0:11051:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e85143 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5e7 expref: 29 pid: 5820 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787691.835336:0:11051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 72 00000100:00100000:0.0:1785787691.835345:0:11051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79280304-55c6-4698-bfc3-29d14648ba45+29:2390:x1872533744865280:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785787691.835367:0:11051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785787691.835380:0:11051:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e85143 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5e7 expref: 29 pid: 5820 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787691.835532:0:11051:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e85143 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5e7 expref: 29 pid: 5820 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787691.835553:0:11051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e85143 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5e7 expref: 29 pid: 5820 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787691.835567:0:11051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9190481f9100) 00010000:00010000:0.0:1785787691.835572:0:11051:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b600/0xe2c2ff68a6e8515f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787691.835581:0:11051:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b600/0xe2c2ff68a6e8515f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787691.835589:0:11051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b600/0xe2c2ff68a6e8515f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787691.835614:0:11051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785787691.835664:0:11051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79280304-55c6-4698-bfc3-29d14648ba45+28:2390:x1872533744865280:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 320us (4341us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787691.835671:0:11051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 72 00010000:00010000:3.0:1785787691.836023:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b600/0xe2c2ff68a6e8515f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787691.836031:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b600/0xe2c2ff68a6e8515f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785787691.836047:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1785787691.836228:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a200/0xe2c2ff68a6e85158 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5ee expref: 29 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787691.836243:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b600/0xe2c2ff68a6e8515f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5ee expref: 28 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787691.836251:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9190481f9100) 00010000:00010000:3.0:1785787691.836253:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1785787691.836256:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91908206b600, rc 0) 00000100:00100000:3.0:1785787691.836291:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+28:11095:x1872533744865152:12345-192.168.203.53@tcp:101:bash.0 Request processed in 15235us (15389us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1785787691.836298:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 191 00000100:00100000:1.0:1785787691.846155:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787691.848273:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744865536 00000100:00100000:2.0:1785787691.848283:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744865536 00000100:00100000:3.0:1785787691.851367:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 192 00000100:00100000:3.0:1785787691.851378:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+28:11095:x1872533744865536:12345-192.168.203.53@tcp:36:bash.0 00010000:00010000:3.0:1785787691.851643:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e8516d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787691.851659:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e8516d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787691.851683:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e8516d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785787691.851737:0:9295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1785787691.851761:0:9295:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007c68c9a7 reply state 000000006f75d5d5 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e8516d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787691.851769:0:9295:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1785787691.851815:0:9295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1785787691.851946:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+32:11095:x1872533744865536:12345-192.168.203.53@tcp:36:bash.0 Request processed in 569us (5799us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1785787691.851953:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 192 00000020:00080000:3.0:1785787691.851957:0:9295:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1785787691.861301:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00010000:00010000:2.0:1785787691.862560:0:3320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e8516d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.862573:0:3320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e8516d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.862580:0:3320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e8516d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.862587:0:3320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f902800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787691.862592:0:3320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e8516d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.862613:0:3320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e8516d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.862628:0:3320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9190481f9100) 00010000:00010000:2.0:1785787691.862630:0:3320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787691.862634:0:3320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e8516d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.862640:0:3320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e8516d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787691.864295:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744865664 00000100:00100000:3.0:1785787691.864306:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744865664 00000100:00100000:3.0:1785787691.865908:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 193 00000100:00100000:3.0:1785787691.865923:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+31:11095:x1872533744865664:12345-192.168.203.53@tcp:101:bash.0 00010000:00010000:3.0:1785787691.865945:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787691.865963:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e85174 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd5f5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787691.866017:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e85174 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5f5 expref: 32 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787691.866029:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e85174 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5f5 expref: 32 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787691.866045:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9190481f9100) 00010000:00010000:3.0:1785787691.866057:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785787691.866060:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f903000, rc 0) 00000100:00100000:3.0:1785787691.866129:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+32:11095:x1872533744865664:12345-192.168.203.53@tcp:101:bash.0 Request processed in 212us (4836us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787691.866136:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 193 00000100:00100000:1.0:1785787691.879028:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787691.879104:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744865792 00000100:00100000:2.0:1785787691.879113:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744865792 00000100:00100000:2.0:1785787691.879177:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 58 00000100:00100000:2.0:1785787691.879186:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+7:11095:x1872533744865792:12345-192.168.203.53@tcp:101:bash.0 00010000:00010000:2.0:1785787691.879201:0:6618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787691.879219:0:6618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f702a1a6/0xe2c2ff68a6e8517b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd5fc expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785787691.879244:0:6618:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a70f528, atime: 0x6a70f526, ctime: 0x6a70f528, blocks: 0xb 00010000:00010000:2.0:1785787691.879263:0:6618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1785787691.879268:0:6618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785787691.879275:0:6618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f702a1a6/0xe2c2ff68a6e8517b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5fc expref: 8 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.879292:0:6618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f702a1a6/0xe2c2ff68a6e8517b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5fc expref: 8 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.879323:0:6618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677ca00, rc 0) 00000100:00080000:3.0:1785787691.879492:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785787691.883024:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+8:11095:x1872533744865792:12345-192.168.203.53@tcp:101:bash.0 Request processed in 3829us (3995us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787691.883038:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 58 00000100:00100000:2.0:1785787691.892255:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787691.892480:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744865920 00000100:00100000:3.0:1785787691.892490:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744865920 00002000:00010000:3.0:1785787691.892527:0:6623:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1785787691.892531:0:6623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91907bc1b800 with x1872533744865920 ext(0->18446744073709551615) 00002000:00010000:3.0:1785787691.892541:0:6623:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91907bc1b800. 00000100:00100000:3.0:1785787691.892575:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 5 00000100:00100000:3.0:1785787691.892585:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bc1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:79280304-55c6-4698-bfc3-29d14648ba45+8:2391:x1872533744865920:12345-192.168.203.53@tcp:10:bash.0 00002000:00010000:3.0:1785787691.892817:0:6623:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1785787691.892821:0:6623:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1785787688 -> 1785787692 00002000:00010000:3.0:1785787691.892823:0:6623:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1785787686 -> 1785787686 00002000:00010000:3.0:1785787691.892852:0:6623:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1785787688 -> 1785787692 00002000:00010000:3.0:1785787691.892856:0:6623:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1785787691.892906:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bc1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:79280304-55c6-4698-bfc3-29d14648ba45+9:2391:x1872533744865920:12345-192.168.203.53@tcp:10:bash.0 Request processed in 322us (657us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1785787691.892914:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 5 00002000:00010000:3.0:1785787691.892917:0:6623:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1785787691.892920:0:6623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91907bc1b800 with x1872533744865920 ext(0->18446744073709551615) 00002000:00010000:3.0:1785787691.892924:0:6623:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91907bc1b800. 00000100:00100000:0.0:1785787691.978265:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787691.979194:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744866048 00000100:00100000:2.0:1785787691.979204:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744866048 00000100:00100000:2.0:1785787691.979252:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 194 00000100:00100000:2.0:1785787691.979261:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+32:11583:x1872533744866048:12345-192.168.203.53@tcp:34:lfs.0 00010000:00010000:2.0:1785787691.979330:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e85182 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.979346:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e85182 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.979369:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e85182 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.979383:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e85189 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.979391:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e85189 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.979396:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e85189 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.979661:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e85190 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.979676:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e85190 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.979683:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e85190 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785787691.979720:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e85190 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.979730:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e85182 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.979736:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e85182 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.979742:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e85182 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.979748:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677da00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787691.979751:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e85182 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.979758:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e85182 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.979768:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff919059e3e900) 00010000:00010000:2.0:1785787691.979771:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787691.979774:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e85182 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.979781:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e85182 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.979797:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e85189 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.979803:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e85189 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.979809:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e85189 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.979815:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677d800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787691.979817:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e85189 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.979823:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e85189 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.979880:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9190481f9700) 00010000:00010000:2.0:1785787691.979882:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787691.979886:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e85189 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.979892:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e85189 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.979905:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e85190 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.979912:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e85190 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.979917:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e85190 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.979928:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677c800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787691.979931:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e85190 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.979937:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e85190 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.979946:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9190481f9100) 00010000:00010000:2.0:1785787691.979949:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787691.979952:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e85190 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787691.979958:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e85190 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787691.980030:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+32:11583:x1872533744866048:12345-192.168.203.53@tcp:34:lfs.0 Request processed in 769us (1771us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787691.980037:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 194 00000100:00100000:2.0:1785787692.041980:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787692.042072:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744866304 00000100:00100000:1.0:1785787692.042081:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744866304 00000100:00100000:1.0:1785787692.042135:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 195 00000100:00100000:1.0:1785787692.042143:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bc18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+32:11586:x1872533744866304:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:1.0:1785787692.042162:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787692.042182:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a000/0xe2c2ff68a6e85197 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd603 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.042245:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e8519e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.042257:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e8519e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.042267:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e8519e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.042445:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206bc00/0xe2c2ff68a6e851a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.042455:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91908206bc00/0xe2c2ff68a6e851a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.042462:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91908206bc00/0xe2c2ff68a6e851a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.042734:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a200/0xe2c2ff68a6e851ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.042743:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a200/0xe2c2ff68a6e851ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.042757:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a200/0xe2c2ff68a6e851ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785787692.042766:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1785787692.042878:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e8519e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.042885:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e8519e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.042891:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e8519e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.042897:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91908206a400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787692.042900:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e8519e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.042907:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e8519e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.042918:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff919059e3e900) 00010000:00010000:1.0:1785787692.042921:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785787692.042926:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e8519e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.042932:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e8519e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.042943:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206bc00/0xe2c2ff68a6e851a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.042948:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91908206bc00/0xe2c2ff68a6e851a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.042961:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91908206bc00/0xe2c2ff68a6e851a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.042966:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91908206bc00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787692.042969:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91908206bc00/0xe2c2ff68a6e851a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.042975:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91908206bc00/0xe2c2ff68a6e851a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.042982:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91905685f100) 00010000:00010000:1.0:1785787692.042984:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785787692.042986:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91908206bc00/0xe2c2ff68a6e851a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.042991:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91908206bc00/0xe2c2ff68a6e851a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.043026:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a000/0xe2c2ff68a6e85197 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd603 expref: 35 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.043038:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a200/0xe2c2ff68a6e851ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd603 expref: 34 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.043045:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9190481f9100) 00010000:00010000:1.0:1785787692.043047:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1785787692.043049:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91908206a200, rc 0) 00000100:00100000:1.0:1785787692.045529:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bc18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+34:11586:x1872533744866304:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 3378us (3547us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1785787692.045554:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 195 00000100:00100000:1.0:1785787692.059178:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787692.062907:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744866432 00000100:00100000:2.0:1785787692.062921:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744866432 00000100:00100000:2.0:1785787692.062985:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 196 00000100:00100000:2.0:1785787692.062996:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905069fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+34:11586:x1872533744866432:12345-192.168.203.53@tcp:54:lfs.0 00010000:00010000:2.0:1785787692.063061:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e851ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.063077:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b600/0xe2c2ff68a6e8515f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5ee expref: 34 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.063104:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e851ba lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.063137:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b600/0xe2c2ff68a6e8515f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5ee expref: 34 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.063150:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b600/0xe2c2ff68a6e8515f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5ee expref: 34 pid: 5822 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787692.063164:0:5821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bc19500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5821:1872533770031360:192.168.203.53@tcp:104: 00000100:00100000:2.0:1785787692.063314:0:5821:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190502eab40 going to sleep for 11 seconds 00000100:00100000:2.0:1785787692.077105:0:5821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bc19500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5821:1872533770031360:192.168.203.53@tcp:104: 00010000:00010000:2.0:1785787692.077134:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e851ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787692.086398:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787692.086536:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744866688 00000100:00100000:0.0:1785787692.086545:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744866688 00000100:00100000:0.0:1785787692.086606:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 52 00000100:00100000:0.0:1785787692.086619:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+35:5608:x1872533744866688:12345-192.168.203.53@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1785787692.086957:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+36:5608:x1872533744866688:12345-192.168.203.53@tcp:35:ldlm_bl.0 Request processed in 340us (576us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1785787692.086964:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 52 00000100:00100000:0.0:1785787692.097352:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787692.097545:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744866816 00000100:00100000:1.0:1785787692.097555:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744866816 00010000:00010000:1.0:1785787692.097592:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b600/0xe2c2ff68a6e8515f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5ee expref: 36 pid: 5822 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787692.097635:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 73 00000100:00100000:1.0:1785787692.097644:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79280304-55c6-4698-bfc3-29d14648ba45+36:2391:x1872533744866816:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785787692.097659:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785787692.097665:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b600/0xe2c2ff68a6e8515f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5ee expref: 36 pid: 5822 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.097677:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b600/0xe2c2ff68a6e8515f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5ee expref: 36 pid: 5822 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.097699:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b600/0xe2c2ff68a6e8515f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5ee expref: 36 pid: 5822 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.097716:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9190481f9100) 00010000:00010000:1.0:1785787692.097721:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e851ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.097729:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e851ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.097736:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e851ba lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.101504:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785787692.101582:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79280304-55c6-4698-bfc3-29d14648ba45+35:2391:x1872533744866816:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 3934us (4233us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787692.101594:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 73 00010000:00010000:2.0:1785787692.102950:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e851ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.102962:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e851ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.103124:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e851ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.103132:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e851ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.103139:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e851ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.103159:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677c800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787692.103163:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e851ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.103170:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e851ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.103184:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9190481f9100) 00010000:00010000:2.0:1785787692.103187:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785787692.103191:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e851ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.103196:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e851ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787692.103283:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905069fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+34:11586:x1872533744866432:12345-192.168.203.53@tcp:54:lfs.0 Request processed in 40289us (44112us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787692.103292:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 196 00000100:00100000:0.0:1785787692.112644:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787692.112716:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744867072 00000100:00100000:1.0:1785787692.112725:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744867072 00000100:00100000:1.0:1785787692.112784:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 53 00000100:00100000:1.0:1785787692.112793:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+34:11586:x1872533744867072:12345-192.168.203.53@tcp:35:lfs.0 00000100:00100000:1.0:1785787692.113131:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+35:11586:x1872533744867072:12345-192.168.203.53@tcp:35:lfs.0 Request processed in 338us (494us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1785787692.113139:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 53 00000100:00100000:0.0:1785787692.268999:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787692.269080:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744867328 00000100:00100000:3.0:1785787692.269090:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744867328 00000100:00100000:3.0:1785787692.269153:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 197 00000100:00100000:3.0:1785787692.269172:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+35:11597:x1872533744867328:12345-192.168.203.53@tcp:101:cat.0 00010000:00010000:3.0:1785787692.269196:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787692.269216:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e851c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd60a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.269390:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e851c8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.269413:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e851c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.269425:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e851c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.269440:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e851cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.269447:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e851cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.269454:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e851cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.269820:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e851d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.269903:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e851d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.269912:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e851d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785787692.269932:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1785787692.270012:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e851c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.270019:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e851c8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.270026:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e851c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.270032:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f902800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787692.270035:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e851c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.270042:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e851c8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.270053:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff919059e3e900) 00010000:00010000:3.0:1785787692.270057:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787692.270060:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e851c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.270066:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e851c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.270078:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e851cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.270083:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e851cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.270097:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e851cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.270102:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787692.270105:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e851cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.270110:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e851cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.270117:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff919055acdd00) 00010000:00010000:3.0:1785787692.270119:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787692.270122:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e851cf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.270127:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e851cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.270162:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e851c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd60a expref: 38 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.270174:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e851d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd60a expref: 37 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.270182:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9190481f9100) 00010000:00010000:3.0:1785787692.270184:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785787692.270186:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f903200, rc 0) 00000100:00100000:3.0:1785787692.270285:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+37:11597:x1872533744867328:12345-192.168.203.53@tcp:101:cat.0 Request processed in 1114us (1293us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1785787692.270301:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 197 00000100:00100000:0.0:1785787692.275869:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787692.275944:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744867584 00000100:00100000:1.0:1785787692.275951:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744867584 00000100:00100000:1.0:1785787692.276003:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 54 00000100:00100000:1.0:1785787692.276012:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+37:11597:x1872533744867584:12345-192.168.203.53@tcp:35:cat.0 00000100:00100000:1.0:1785787692.276212:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+38:11597:x1872533744867584:12345-192.168.203.53@tcp:35:cat.0 Request processed in 200us (382us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1785787692.276219:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 54 00000100:00100000:0.0:1785787692.300117:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787692.300242:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744867840 00000100:00100000:3.0:1785787692.300253:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744867840 00000100:00100000:3.0:1785787692.300319:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 198 00000100:00100000:3.0:1785787692.300328:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077128e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+38:11598:x1872533744867840:12345-192.168.203.53@tcp:36:rm.0 00010000:00010000:3.0:1785787692.300381:0:9295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1785787692.300414:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e851d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd60a expref: 38 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.300437:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a200/0xe2c2ff68a6e851ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd603 expref: 37 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.300451:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e85174 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5f5 expref: 36 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.300461:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9190481f9100) 00010000:00010000:3.0:1785787692.300472:0:9295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785787692.300491:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e851e4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.300503:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e851e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.300513:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e851e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.300525:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e851eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.300548:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e851eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.300554:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e851eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.300946:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e851f2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.300954:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e851f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.300961:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e851f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1785787692.302771:0:9295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:3.0:1785787692.302780:0:9295:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 479546951459ns, next at 480546949399ns, rc = 0 00010000:00010000:3.0:1785787692.303338:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e851f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.303352:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e851f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.303360:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e851f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.303368:0:9295:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e851f9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.303374:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e851f9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.303390:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e851f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.303449:0:9295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1785787692.303470:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e851f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.303477:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e851f2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.303483:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e851f2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.303490:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f902800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787692.303494:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e851f2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.303501:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e851f2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.303511:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff919055acde00) 00010000:00010000:3.0:1785787692.303514:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1785787692.303517:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e851f2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.303523:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e851f2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.303539:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e851e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.303545:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e851e4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.303556:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e851e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.303561:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903e00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787692.303564:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e851e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.303571:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e851e4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.303591:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff919059e3e900) 00010000:00010000:3.0:1785787692.303593:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787692.303596:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e851e4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.303603:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e851e4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785787692.303614:0:9295:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d71bd164 reply state 00000000d0833f84 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e851eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787692.303621:0:9295:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785787692.303701:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077128e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+37:11598:x1872533744867840:12345-192.168.203.53@tcp:36:rm.0 Request processed in 3371us (3592us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1785787692.303710:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 198 00010000:00010000:2.0:1785787692.307615:0:3319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e851eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.307629:0:3319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e851eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.307636:0:3319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e851eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.307642:0:3319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787692.307647:0:3319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e851eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.307669:0:3319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e851eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.307684:0:3319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff919055acdd00) 00010000:00010000:2.0:1785787692.307687:0:3319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787692.307691:0:3319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e851eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.307698:0:3319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e851eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.310694:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785787692.310706:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e851f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.310716:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903a00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785787692.310720:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e851f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.310746:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e851f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.310761:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff919055acde00) 00010000:00010000:1.0:1785787692.310764:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785787692.310768:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e851f9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.310774:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e851f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.310793:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787692.310794:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787692.310796:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787692.357020:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787692.357123:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744868096 00000100:00100000:1.0:1785787692.357132:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744868096 00000100:00100000:1.0:1785787692.357190:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 199 00000100:00100000:1.0:1785787692.357200:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+36:11604:x1872533744868096:12345-192.168.203.53@tcp:101:bash.0 00010000:00010000:1.0:1785787692.357223:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787692.357243:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b600/0xe2c2ff68a6e85200 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd611 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.357358:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e85207 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.357371:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e85207 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.357383:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e85207 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.357424:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e8520e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.357432:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e8520e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.357439:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e8520e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785787692.358110:0:5822:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1785787692.358257:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b000/0xe2c2ff68a6e85215 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.358266:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b000/0xe2c2ff68a6e85215 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.358274:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b000/0xe2c2ff68a6e85215 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.358304:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e85207 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.358312:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e85207 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.358319:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e85207 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.358325:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91908206a400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787692.358329:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e85207 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.358347:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e85207 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.358357:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff919059e3e900) 00010000:00010000:1.0:1785787692.358360:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785787692.358365:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e85207 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.358371:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e85207 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785787692.358384:0:5822:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eed96374 reply state 00000000848fbc93 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e8520e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787692.358392:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785787692.358427:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b600/0xe2c2ff68a6e85200 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd611 expref: 39 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.358441:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b000/0xe2c2ff68a6e85215 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd611 expref: 38 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.358449:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91905685fc00) 00010000:00010000:1.0:1785787692.358451:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785787692.358454:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91908206b000, rc 0) 00000100:00100000:1.0:1785787692.358508:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+39:11604:x1872533744868096:12345-192.168.203.53@tcp:101:bash.0 Request processed in 1310us (1497us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1785787692.358712:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 199 00010000:00010000:2.0:1785787692.361591:0:3320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e8520e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.361607:0:3320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e8520e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.361614:0:3320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e8520e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.361620:0:3320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91908206ae00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787692.361624:0:3320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e8520e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.361630:0:3320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e8520e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.361645:0:3320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91905685f100) 00010000:00010000:2.0:1785787692.361648:0:3320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787692.361652:0:3320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e8520e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.361670:0:3320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e8520e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787692.365025:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787692.365085:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744868224 00000100:00100000:2.0:1785787692.365094:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744868224 00000100:00100000:2.0:1785787692.365154:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 59 00000100:00100000:2.0:1785787692.365163:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:79280304-55c6-4698-bfc3-29d14648ba45+5:2388:x1872533744868224:12345-192.168.203.53@tcp:101:bash.0 00000100:00080000:3.0:1785787692.365177:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1785787692.365180:0:6617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787692.365198:0:6617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bab96d98/0xe2c2ff68a6e85223 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd618 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785787692.365223:0:6617:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785787692.365240:0:6617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1785787692.365245:0:6617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785787692.365253:0:6617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bab96d98/0xe2c2ff68a6e85223 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd618 expref: 6 pid: 6617 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.365271:0:6617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bab96d98/0xe2c2ff68a6e85223 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd618 expref: 6 pid: 6617 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.365283:0:6617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677c800, rc 0) 00000100:00100000:2.0:1785787692.365333:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:79280304-55c6-4698-bfc3-29d14648ba45+6:2388:x1872533744868224:12345-192.168.203.53@tcp:101:bash.0 Request processed in 172us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787692.365341:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 59 00000100:00100000:0.0:1785787692.384381:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787692.384481:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744868352 00000100:00100000:1.0:1785787692.384490:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744868352 00000100:00100000:1.0:1785787692.384565:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 60 00000100:00100000:1.0:1785787692.384575:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:79280304-55c6-4698-bfc3-29d14648ba45+6:11604:x1872533744868352:12345-192.168.203.53@tcp:101:bash.0 00010000:00010000:1.0:1785787692.384591:0:6619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787692.384608:0:6619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017e2d4ef/0xe2c2ff68a6e8522a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd61f expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.384637:0:6619:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bab96d98/0xe2c2ff68a6e85223 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd618 expref: 7 pid: 6617 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.384646:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785787692.384650:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785787692.384655:0:6619:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017e2d4ef/0xe2c2ff68a6e8522a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd61f expref: 7 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.384686:0:6619:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bab96d98/0xe2c2ff68a6e85223 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd618 expref: 7 pid: 6617 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.384699:0:6619:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bab96d98/0xe2c2ff68a6e85223 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd618 expref: 7 pid: 6617 timeout: 579 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787692.384712:0:6619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919048780e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6619:1872533770031488:192.168.203.53@tcp:104: 00000100:00100000:1.0:1785787692.384794:0:6619:0:(client.c:2702:ptlrpc_set_wait()) set ffff91907fe40900 going to sleep for 11 seconds 00000100:00100000:0.0:1785787692.388897:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787692.388951:0:6619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919048780e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6619:1872533770031488:192.168.203.53@tcp:104: 00010000:00010000:1.0:1785787692.388981:0:6619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000017e2d4ef/0xe2c2ff68a6e8522a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd61f expref: 7 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787692.389003:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744868480 00000100:00100000:3.0:1785787692.389009:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744868480 00010000:00010000:1.0:1785787692.389017:0:6619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91908206b600, rc 0) 00010000:00010000:3.0:1785787692.389034:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bab96d98/0xe2c2ff68a6e85223 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd618 expref: 8 pid: 6617 timeout: 579 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787692.389064:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:79280304-55c6-4698-bfc3-29d14648ba45+8:11604:x1872533744868352:12345-192.168.203.53@tcp:101:bash.0 Request processed in 4490us (4691us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787692.389072:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 60 00000100:00100000:3.0:1785787692.389079:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 74 00000100:00100000:3.0:1785787692.389086:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051465850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79280304-55c6-4698-bfc3-29d14648ba45+7:2391:x1872533744868480:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785787692.389097:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787692.389117:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bab96d98/0xe2c2ff68a6e85223 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd618 expref: 7 pid: 6617 timeout: 579 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.389130:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bab96d98/0xe2c2ff68a6e85223 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd618 expref: 7 pid: 6617 timeout: 579 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.389150:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bab96d98/0xe2c2ff68a6e85223 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd618 expref: 7 pid: 6617 timeout: 579 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.389162:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785787692.389166:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785787692.389173:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000017e2d4ef/0xe2c2ff68a6e8522a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd61f expref: 6 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.389183:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017e2d4ef/0xe2c2ff68a6e8522a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd61f expref: 6 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.389213:0:5807:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000017e2d4ef/0xe2c2ff68a6e8522a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd61f expref: 6 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787692.389224:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907be0fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5807:1872533770031616:192.168.203.53@tcp:105: 00000100:00100000:3.0:1785787692.389268:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff918f42eee780 going to sleep for 11 seconds 00000100:00100000:3.0:1785787692.396331:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907be0fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5807:1872533770031616:192.168.203.53@tcp:105: 00010000:00010000:3.0:1785787692.396665:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787692.396751:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051465850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79280304-55c6-4698-bfc3-29d14648ba45+6:2391:x1872533744868480:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 7664us (7859us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787692.396762:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 74 00000100:00100000:0.0:1785787692.405681:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787692.409973:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744868736 00000100:00100000:1.0:1785787692.409986:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744868736 00000100:00100000:1.0:1785787692.410110:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 55 00000100:00100000:1.0:1785787692.410122:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+38:11604:x1872533744868736:12345-192.168.203.53@tcp:35:bash.0 00000100:00100000:1.0:1785787692.410466:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+39:11604:x1872533744868736:12345-192.168.203.53@tcp:35:bash.0 Request processed in 345us (4791us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1785787692.410474:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 55 00010000:00010000:3.0:1785787692.531101:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787692.557507:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787692.557719:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744868864 00000100:00100000:2.0:1785787692.557728:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744868864 00000100:00100000:2.0:1785787692.557800:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 200 00000100:00100000:2.0:1785787692.557811:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+39:11620:x1872533744868864:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:3.0:1785787692.558481:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787692.558503:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e85231 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd626 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.558561:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e85238 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.558575:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e85238 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.558586:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e85238 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785787692.558641:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1785787692.558645:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1785787692.558667:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e85238 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.558691:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e85231 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd626 expref: 41 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.558709:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e85238 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd626 expref: 40 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.558726:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff919059e3e900) 00010000:00010000:3.0:1785787692.558729:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785787692.558732:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f902800, rc 0) 00000100:00100000:3.0:1785787692.558792:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+40:11620:x1872533744868864:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 983us (1293us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787692.558799:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 200 00000100:00100000:0.0:1785787692.563441:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787692.563501:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744869120 00000100:00100000:3.0:1785787692.563510:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744869120 00000100:00100000:3.0:1785787692.563557:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 201 00000100:00100000:3.0:1785787692.563566:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+40:11620:x1872533744869120:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:3.0:1785787692.563590:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787692.563609:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e8523f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd62d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.563693:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e85246 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.563706:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e85246 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.563717:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e85246 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785787692.563728:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1785787692.563860:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e8523f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd62d expref: 43 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.563895:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e85246 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd62d expref: 42 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.563903:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91905685fc00) 00010000:00010000:3.0:1785787692.563906:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785787692.563910:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f903200, rc 0) 00000100:00100000:3.0:1785787692.563963:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+42:11620:x1872533744869120:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 397us (529us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1785787692.563970:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 201 00000100:00100000:0.0:1785787692.572970:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787692.573009:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787692.573074:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744869248 00000100:00100000:3.0:1785787692.573084:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744869248 00000100:00100000:3.0:1785787692.573139:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 16 00000100:00100000:3.0:1785787692.573156:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79280304-55c6-4698-bfc3-29d14648ba45+42:2389:x1872533744869248:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785787692.573170:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787692.573197:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e85246 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd62d expref: 42 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.573212:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91905685fc00) 00010000:00010000:3.0:1785787692.573216:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787692.573277:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79280304-55c6-4698-bfc3-29d14648ba45+41:2389:x1872533744869248:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 122us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787692.573284:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 16 00000100:00100000:1.0:1785787692.573454:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744869504 00000100:00100000:1.0:1785787692.573458:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744869504 00000100:00100000:1.0:1785787692.573496:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 202 00000100:00100000:1.0:1785787692.573502:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076ec9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+41:11620:x1872533744869504:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:1.0:1785787692.573522:0:9295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787692.573536:0:9295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e85254 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd634 expref: -99 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.573626:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e8525b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.573639:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e8525b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.573649:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e8525b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785787692.573672:0:9295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1785787692.573779:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e85254 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd634 expref: 44 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.573795:0:9295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e8525b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd634 expref: 43 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.573802:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91905685fc00) 00010000:00010000:1.0:1785787692.573805:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1785787692.573807:0:9295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91908206ae00, rc 0) 00000100:00100000:1.0:1785787692.574135:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076ec9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+43:11620:x1872533744869504:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 632us (1123us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1785787692.574143:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 202 00000100:00100000:0.0:1785787692.581336:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787692.581665:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744869632 00000100:00100000:2.0:1785787692.581674:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744869632 00000100:00100000:2.0:1785787692.581725:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 61 00000100:00100000:2.0:1785787692.581734:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:79280304-55c6-4698-bfc3-29d14648ba45+6:2391:x1872533744869632:12345-192.168.203.53@tcp:1:lfs.0 00010000:00010000:2.0:1785787692.581773:0:6617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7c237a0/0xe2c2ff68a6e85269 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.581791:0:6617:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000017e2d4ef/0xe2c2ff68a6e8522a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd61f expref: 6 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.581800:0:6617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785787692.581804:0:6617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785787692.581808:0:6617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7c237a0/0xe2c2ff68a6e85269 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.582988:0:6617:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000017e2d4ef/0xe2c2ff68a6e8522a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd61f expref: 6 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.583006:0:6617:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000017e2d4ef/0xe2c2ff68a6e8522a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd61f expref: 6 pid: 6619 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787692.583019:0:6617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bc19500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6617:1872533770031744:192.168.203.53@tcp:104: 00000100:00100000:2.0:1785787692.583093:0:6617:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190502eab40 going to sleep for 11 seconds 00000100:00100000:0.0:1785787692.591092:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787692.591998:0:6622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744869760 00000100:00100000:1.0:1785787692.592007:0:6622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744869760 00002000:00100000:1.0:1785787692.592050:0:6622:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff918f41d9c000 x1872533744869760/t0(0) o4->79280304-55c6-4698-bfc3-29d14648ba45@192.168.203.53@tcp:548/0 lens 504/0 e 0 to 0 dl 1785787703 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785787692.592062:0:6622:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff918f41d9c000 with x1872533744869760 ext(0->8) 00010000:00010000:1.0:1785787692.592071:0:6622:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000017e2d4ef/0xe2c2ff68a6e8522a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd61f expref: 7 pid: 6619 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.592088:0:6622:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000017e2d4ef/0xe2c2ff68a6e8522a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd61f expref: 7 pid: 6619 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1785787692.592096:0:6622:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff918f41d9c000 00000100:00100000:1.0:1785787692.592120:0:6622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 3 00000100:00100000:1.0:1785787692.592141:0:6622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41d9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:79280304-55c6-4698-bfc3-29d14648ba45+7:2390:x1872533744869760:12345-192.168.203.53@tcp:4:lfs.0 00000100:00100000:1.0:1785787692.592733:0:6622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41d9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:79280304-55c6-4698-bfc3-29d14648ba45+9:2390:x1872533744869760:12345-192.168.203.53@tcp:4:lfs.0 Request processed in 590us (1645us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1785787692.592741:0:6622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 3 00002000:00100000:1.0:1785787692.592748:0:6622:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff918f41d9c000 x1872533744869760/t4294967308(0) o4->79280304-55c6-4698-bfc3-29d14648ba45@192.168.203.53@tcp:548/0 lens 504/448 e 0 to 0 dl 1785787703 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785787692.592757:0:6622:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff918f41d9c000 with x1872533744869760 ext(0->8) 00010000:00010000:1.0:1785787692.592763:0:6622:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000017e2d4ef/0xe2c2ff68a6e8522a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd61f expref: 9 pid: 6619 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.592774:0:6622:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000017e2d4ef/0xe2c2ff68a6e8522a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd61f expref: 9 pid: 6619 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1785787692.592782:0:6622:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff918f41d9c000 00000100:00100000:2.0:1785787692.592885:0:6617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bc19500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6617:1872533770031744:192.168.203.53@tcp:104: 00010000:00010000:2.0:1785787692.592911:0:6617:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e7c237a0/0xe2c2ff68a6e85269 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787692.604222:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787692.604304:0:11051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744869888 00000100:00100000:2.0:1785787692.604312:0:11051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744869888 00010000:00010000:2.0:1785787692.604354:0:11051:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000017e2d4ef/0xe2c2ff68a6e8522a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd61f expref: 9 pid: 6619 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787692.604389:0:11051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 75 00000100:00100000:2.0:1785787692.604398:0:11051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79280304-55c6-4698-bfc3-29d14648ba45+9:2388:x1872533744869888:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785787692.604420:0:11051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1785787692.604438:0:11051:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1785787692.604440:0:11051:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1785787692 00002000:00010000:2.0:1785787692.604443:0:11051:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1785787692 00002000:00010000:2.0:1785787692.604445:0:11051:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1785787692 00010000:00010000:2.0:1785787692.604451:0:11051:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000017e2d4ef/0xe2c2ff68a6e8522a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd61f expref: 9 pid: 6619 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.604465:0:11051:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000017e2d4ef/0xe2c2ff68a6e8522a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd61f expref: 9 pid: 6619 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.604487:0:11051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017e2d4ef/0xe2c2ff68a6e8522a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd61f expref: 9 pid: 6619 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.604504:0:11051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785787692.604509:0:11051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785787692.604527:0:11051:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e7c237a0/0xe2c2ff68a6e85269 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.604537:0:11051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7c237a0/0xe2c2ff68a6e85269 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.604792:0:11051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785787692.604892:0:11051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79280304-55c6-4698-bfc3-29d14648ba45+8:2388:x1872533744869888:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 494us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787692.604901:0:11051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 75 00010000:00010000:1.0:1785787692.607658:0:6617:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e7c237a0/0xe2c2ff68a6e85269 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.607677:0:6617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7c237a0/0xe2c2ff68a6e85269 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.607708:0:6617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7c237a0/0xe2c2ff68a6e85269 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.607716:0:6617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7c237a0/0xe2c2ff68a6e85269 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.607742:0:6617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7c237a0/0xe2c2ff68a6e85269 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.607749:0:6617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677da00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785787692.607753:0:6617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7c237a0/0xe2c2ff68a6e85269 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.607762:0:6617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7c237a0/0xe2c2ff68a6e85269 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.607776:0:6617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7c237a0/0xe2c2ff68a6e85269 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.607783:0:6617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7c237a0/0xe2c2ff68a6e85269 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787692.608505:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:79280304-55c6-4698-bfc3-29d14648ba45+7:2391:x1872533744869632:12345-192.168.203.53@tcp:1:lfs.0 Request processed in 26768us (27173us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787692.608515:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 61 00000100:00100000:0.0:1785787692.621471:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787692.624656:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744870144 00000100:00100000:3.0:1785787692.624668:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744870144 00000100:00100000:2.0:1785787692.629542:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 56 00000100:00100000:2.0:1785787692.629556:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190451bd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+43:11620:x1872533744870144:12345-192.168.203.53@tcp:35:lfs.0 00000004:00010000:2.0:1785787692.629626:0:5824:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e8525b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd634 expref: 43 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785787692.630056:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1785787692.630098:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1785787692.630515:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1785787692.630650:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85270 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.630665:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b000/0xe2c2ff68a6e85215 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd611 expref: 47 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.630674:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85270 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.630704:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b000/0xe2c2ff68a6e85215 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd611 expref: 47 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.630730:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b000/0xe2c2ff68a6e85215 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd611 expref: 47 pid: 5822 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787692.630743:0:5824:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bc19500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5824:1872533770031872:192.168.203.53@tcp:104: 00000100:00100000:2.0:1785787692.631016:0:5824:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190507eab40 going to sleep for 11 seconds 00000100:00100000:0.0:1785787692.644596:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787692.645826:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744870272 00000100:00100000:3.0:1785787692.645880:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744870272 00010000:00010000:3.0:1785787692.645916:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b000/0xe2c2ff68a6e85215 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd611 expref: 48 pid: 5822 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787692.645947:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 76 00000100:00100000:3.0:1785787692.645955:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41d9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79280304-55c6-4698-bfc3-29d14648ba45+48:2390:x1872533744870272:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785787692.645968:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787692.645974:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b000/0xe2c2ff68a6e85215 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd611 expref: 48 pid: 5822 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.645986:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b000/0xe2c2ff68a6e85215 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd611 expref: 48 pid: 5822 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.646004:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91905685fc00) 00010000:00010000:3.0:1785787692.646010:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85270 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.646019:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85270 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.646025:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85270 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.646041:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787692.646099:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41d9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79280304-55c6-4698-bfc3-29d14648ba45+48:2390:x1872533744870272:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 144us (1511us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787692.646106:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 76 00010000:00010000:2.0:1785787692.648049:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b000/0xe2c2ff68a6e85215 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd611 expref: 47 pid: 5822 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787692.648069:0:5824:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bc19500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5824:1872533770031872:192.168.203.53@tcp:104: 00010000:00010000:2.0:1785787692.648088:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85270 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.648097:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85270 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.648104:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85270 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785787692.648209:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1785787692.648679:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1785787692.648771:0:5824:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bc19500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5824:1872533770032000:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1785787692.648817:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787692.649007:0:5824:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190507ea6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785787692.652240:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770032000 00000100:00100000:0.0:1785787692.652253:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770032000 00000100:00080000:3.0:1785787692.652341:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785787692.652419:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1785787692.652429:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bc19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5824:x1872533770032000:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1785787692.652572:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bc19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5824:x1872533770032000:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 144us (3754us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787692.652591:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1785787692.656031:0:5824:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bc19500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5824:1872533770032000:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1785787692.657105:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1785787692.657177:0:5824:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bc19500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5824:1872533770032128:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1785787692.657232:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787692.657253:0:5824:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190507eab40 going to sleep for 11 seconds 00000100:00100000:1.0:1785787692.657357:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770032128 00000100:00100000:1.0:1785787692.657364:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770032128 00000100:00100000:1.0:1785787692.657395:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1785787692.657411:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bc1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5824:x1872533770032128:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1785787692.657690:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bc1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5824:x1872533770032128:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 287us (457us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1785787692.657707:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1785787692.657714:0:5824:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bc19500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5824:1872533770032128:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1785787692.657762:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1785787692.657795:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85270 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.657804:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85270 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.657811:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85270 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.657817:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677ce00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787692.657821:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85270 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.657848:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85270 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.657862:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91905685fc00) 00010000:00010000:3.0:1785787692.657865:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1785787692.657870:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85270 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.657876:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85270 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785787692.658029:0:5824:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1785787692.658114:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:3.0:1785787692.658124:0:5824:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 479902294942ns, next at 480902293127ns, rc = 0 00000001:00080000:3.0:1785787692.658130:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1785787692.658484:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91905685fc00) 00010000:00010000:3.0:1785787692.658487:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1785787692.658499:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e8525b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd634 expref: 51 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787692.658590:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190451bd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+50:11620:x1872533744870144:12345-192.168.203.53@tcp:35:lfs.0 Request processed in 29037us (37127us total) trans 4294967494 rc 0/0 00000100:00100000:3.0:1785787692.658598:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 56 00000020:00080000:3.0:1785787692.658602:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1785787692.661492:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787692.661642:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744870400 00000100:00100000:1.0:1785787692.661650:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744870400 00000100:00100000:1.0:1785787692.661695:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 203 00000100:00100000:1.0:1785787692.661704:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41d9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+50:11620:x1872533744870400:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:1.0:1785787692.661724:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787692.661744:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a200/0xe2c2ff68a6e85277 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd63b expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.661789:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a200/0xe2c2ff68a6e85277 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd63b expref: 51 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.661802:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a200/0xe2c2ff68a6e85277 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd63b expref: 51 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.661817:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91905685ff00) 00010000:00010000:1.0:1785787692.661820:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1785787692.661823:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91908206a200, rc 0) 00000100:00100000:1.0:1785787692.662990:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41d9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+51:11620:x1872533744870400:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 1284us (1500us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787692.662998:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 203 00000100:00100000:2.0:1785787692.671528:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787692.676656:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744870656 00000100:00100000:1.0:1785787692.676669:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744870656 00000100:00100000:1.0:1785787692.676729:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 57 00000100:00100000:1.0:1785787692.676739:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bc18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+51:11620:x1872533744870656:12345-192.168.203.53@tcp:35:lfs.0 00000100:00100000:1.0:1785787692.677138:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bc18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+52:11620:x1872533744870656:12345-192.168.203.53@tcp:35:lfs.0 Request processed in 399us (5616us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1785787692.677158:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 57 00000100:00100000:1.0:1785787692.769802:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787692.769896:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744870784 00000100:00100000:3.0:1785787692.769905:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744870784 00000100:00100000:3.0:1785787692.769958:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 204 00000100:00100000:3.0:1785787692.769969:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+52:11630:x1872533744870784:12345-192.168.203.53@tcp:34:lfs.0 00010000:00010000:3.0:1785787692.770036:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e8527e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.770051:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e8527e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.770062:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e8527e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.770075:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e85285 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.770081:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e85285 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.770086:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e85285 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.770488:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e8528c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.770513:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e8528c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.770521:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e8528c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785787692.770563:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e8528c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.770575:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e8527e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.770710:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e8527e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.770716:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e8527e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.770721:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903200 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787692.770724:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e8527e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.770731:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e8527e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.770741:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff919059e3e900) 00010000:00010000:3.0:1785787692.770744:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787692.770749:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e8527e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.770754:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e8527e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.770774:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e85285 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.770780:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e85285 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.770786:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e85285 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.770791:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787692.770794:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e85285 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.770800:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e85285 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.770808:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff919055acd900) 00010000:00010000:3.0:1785787692.770810:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787692.770812:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e85285 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.770817:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e85285 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.770847:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e8528c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.770854:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e8528c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.770998:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e8528c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.771009:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903e00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787692.771012:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e8528c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.771018:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e8528c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.771026:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91905685ff00) 00010000:00010000:3.0:1785787692.771028:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787692.771032:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e8528c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.771038:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e8528c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787692.771103:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+52:11630:x1872533744870784:12345-192.168.203.53@tcp:34:lfs.0 Request processed in 1135us (1307us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787692.771111:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 204 00000100:00100000:0.0:1785787692.839085:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787692.839166:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744871040 00000100:00100000:3.0:1785787692.839174:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744871040 00000100:00100000:3.0:1785787692.839230:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 205 00000100:00100000:3.0:1785787692.839238:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+52:11633:x1872533744871040:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:3.0:1785787692.839256:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787692.839284:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e85293 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd642 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.839347:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e8529a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.839378:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e8529a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.839389:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e8529a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.839419:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e852a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.839427:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e852a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.839433:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e852a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.839546:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e852a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.839555:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e852a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.839562:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e852a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785787692.839572:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1785787692.839667:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e8529a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.839674:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e8529a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.839680:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e8529a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.839692:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787692.839696:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e8529a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.839702:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e8529a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.839712:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff919059e3e900) 00010000:00010000:3.0:1785787692.839715:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787692.839718:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e8529a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.839724:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e8529a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.839736:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e852a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.839742:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e852a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.839747:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e852a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.839751:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903200 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787692.839754:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e852a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.839759:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e852a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.839775:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff919055acd900) 00010000:00010000:3.0:1785787692.839777:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787692.839780:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e852a1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.839785:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e852a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.839819:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e85293 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd642 expref: 55 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.839872:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e852a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd642 expref: 54 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.839880:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91905685ff00) 00010000:00010000:3.0:1785787692.839882:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785787692.839884:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f903a00, rc 0) 00000100:00100000:3.0:1785787692.839942:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+54:11633:x1872533744871040:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 704us (865us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1785787692.839949:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 205 00000100:00100000:2.0:1785787692.849652:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787692.849751:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744871168 00000100:00100000:1.0:1785787692.849760:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744871168 00000100:00100000:1.0:1785787692.849813:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 206 00000100:00100000:1.0:1785787692.849822:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907732dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+54:11633:x1872533744871168:12345-192.168.203.53@tcp:54:lfs.0 00010000:00010000:1.0:1785787692.849911:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a000/0xe2c2ff68a6e852b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.849927:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a000/0xe2c2ff68a6e852b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.849938:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a000/0xe2c2ff68a6e852b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.849965:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a000/0xe2c2ff68a6e852b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.849972:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a000/0xe2c2ff68a6e852b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.849979:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a000/0xe2c2ff68a6e852b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.849984:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91908206a000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787692.849988:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a000/0xe2c2ff68a6e852b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.849995:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a000/0xe2c2ff68a6e852b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.850016:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91905685ff00) 00010000:00010000:1.0:1785787692.850019:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785787692.850023:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a000/0xe2c2ff68a6e852b6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.850029:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a000/0xe2c2ff68a6e852b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787692.850096:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907732dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+54:11633:x1872533744871168:12345-192.168.203.53@tcp:54:lfs.0 Request processed in 275us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787692.850103:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 206 00000100:00100000:0.0:1785787692.851884:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787692.851946:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744871424 00000100:00100000:3.0:1785787692.851952:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744871424 00000100:00100000:3.0:1785787692.851989:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 58 00000100:00100000:3.0:1785787692.851996:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+54:11633:x1872533744871424:12345-192.168.203.53@tcp:35:lfs.0 00000100:00100000:3.0:1785787692.852174:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+55:11633:x1872533744871424:12345-192.168.203.53@tcp:35:lfs.0 Request processed in 178us (292us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1785787692.852181:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 58 00000100:00100000:0.0:1785787692.937447:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787692.937524:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744871680 00000100:00100000:3.0:1785787692.937533:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744871680 00000100:00100000:3.0:1785787692.937594:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 207 00000100:00100000:3.0:1785787692.937604:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+55:11643:x1872533744871680:12345-192.168.203.53@tcp:101:bash.0 00010000:00010000:3.0:1785787692.937626:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787692.937629:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1785787692.937655:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e85238 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd626 expref: 55 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.937674:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff919059e3e900) 00010000:00010000:3.0:1785787692.937679:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785787692.937692:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e852bd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd649 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.937775:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e852c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.937788:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e852a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd642 expref: 55 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.937795:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e852c4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.937824:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e852a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd642 expref: 55 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.937878:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e852a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd642 expref: 55 pid: 5820 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787692.937911:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907be0ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5820:1872533770032256:192.168.203.53@tcp:104: 00000100:00100000:3.0:1785787692.937996:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905064ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1785787692.940220:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907be0ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5820:1872533770032256:192.168.203.53@tcp:104: 00010000:00010000:3.0:1785787692.940241:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e852c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787692.940616:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787692.940675:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744871808 00000100:00100000:3.0:1785787692.940681:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744871808 00010000:00010000:3.0:1785787692.940708:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e852a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd642 expref: 56 pid: 5820 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787692.940741:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 77 00000100:00100000:3.0:1785787692.940750:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79280304-55c6-4698-bfc3-29d14648ba45+56:2390:x1872533744871808:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785787692.940761:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787692.940767:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e852a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd642 expref: 56 pid: 5820 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.940778:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e852a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd642 expref: 56 pid: 5820 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.940795:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e852a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd642 expref: 56 pid: 5820 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.940807:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91905685ff00) 00010000:00010000:3.0:1785787692.940811:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e852c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.940846:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e852c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.940854:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e852c4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.940882:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787692.941049:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79280304-55c6-4698-bfc3-29d14648ba45+55:2390:x1872533744871808:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 298us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787692.941056:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 77 00010000:00010000:0.0:1785787692.941134:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e852c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787692.941142:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e852c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785787692.941156:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1785787692.941284:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903e00/0xe2c2ff68a6e852bd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd649 expref: 56 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787692.941297:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e852c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd649 expref: 55 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787692.941304:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91905685ff00) 00010000:00010000:0.0:1785787692.941307:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1785787692.941309:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f903200, rc 0) 00000100:00100000:0.0:1785787692.941332:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+55:11643:x1872533744871680:12345-192.168.203.53@tcp:101:bash.0 Request processed in 3731us (3896us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1785787692.941339:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 207 00000100:00100000:2.0:1785787692.953397:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787692.958076:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744872064 00000100:00100000:3.0:1785787692.958088:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744872064 00000100:00100000:3.0:1785787692.958151:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 208 00000100:00100000:3.0:1785787692.958161:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907732f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+55:11643:x1872533744872064:12345-192.168.203.53@tcp:36:bash.0 00010000:00010000:3.0:1785787692.958432:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e852d2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.958449:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e852d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.958460:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e852d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785787692.958507:0:9295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1785787692.958529:0:9295:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009972dc68 reply state 000000000a560251 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e852d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787692.958537:0:9295:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785787692.958627:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907732f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+58:11643:x1872533744872064:12345-192.168.203.53@tcp:36:bash.0 Request processed in 466us (5236us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1785787692.958645:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 208 00000020:00080000:3.0:1785787692.958649:0:9295:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785787692.961896:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787692.962191:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744872192 00000100:00100000:1.0:1785787692.962199:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744872192 00000100:00100000:1.0:1785787692.962239:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 209 00000100:00100000:1.0:1785787692.962246:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+58:11643:x1872533744872192:12345-192.168.203.53@tcp:101:bash.0 00010000:00010000:1.0:1785787692.962275:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787692.962293:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91908206bc00/0xe2c2ff68a6e852d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd650 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.962360:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e852e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.962373:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e852c4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd649 expref: 59 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.962380:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e852d2 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.962386:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e852e0 lrc: 5/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.962422:0:5822:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e852d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.962445:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e852c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd649 expref: 59 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787692.962458:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e852c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd649 expref: 59 pid: 5820 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787692.962471:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919048781880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5822:1872533770032384:192.168.203.53@tcp:104: 00000100:00100000:1.0:1785787692.962537:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff91907fe40600 going to sleep for 11 seconds 00000100:00100000:1.0:1785787692.964693:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919048781880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5822:1872533770032384:192.168.203.53@tcp:104: 00010000:00010000:1.0:1785787692.964717:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e852e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787692.965322:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00010000:00010000:2.0:1785787692.968682:0:3319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e852d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.968698:0:3319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e852d2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.968705:0:3319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e852d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.968711:0:3319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f902800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787692.968715:0:3319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e852d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.968723:0:3319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e852d2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.968740:0:3319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91905685ff00) 00010000:00010000:2.0:1785787692.968743:0:3319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787692.968747:0:3319:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e852e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.968757:0:3319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e852d2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787692.968763:0:3319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e852d2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787692.969090:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744872320 00000100:00100000:0.0:1785787692.969100:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744872320 00010000:00010000:0.0:1785787692.969133:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e852c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd649 expref: 59 pid: 5820 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787692.969283:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 78 00000100:00100000:0.0:1785787692.969293:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79280304-55c6-4698-bfc3-29d14648ba45+59:2391:x1872533744872320:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785787692.969306:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785787692.969313:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e852c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd649 expref: 59 pid: 5820 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787692.969324:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e852c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd649 expref: 59 pid: 5820 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787692.969340:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e852c4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd649 expref: 59 pid: 5820 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787692.969350:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91905685ff00) 00010000:00010000:0.0:1785787692.969354:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e852e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787692.969361:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e852e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787692.969369:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e852e0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787692.969408:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785787692.969465:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79280304-55c6-4698-bfc3-29d14648ba45+58:2391:x1872533744872320:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 174us (4144us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787692.969473:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 78 00010000:00010000:3.0:1785787692.970028:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e852e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.970037:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e852e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785787692.970077:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1785787692.970081:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1785787692.970100:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e852e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.970128:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91908206bc00/0xe2c2ff68a6e852d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd650 expref: 58 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.970151:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e852e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd650 expref: 57 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787692.970159:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91905685ff00) 00010000:00010000:3.0:1785787692.970162:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785787692.970164:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91908206ae00, rc 0) 00000100:00100000:3.0:1785787692.970203:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+57:11643:x1872533744872192:12345-192.168.203.53@tcp:101:bash.0 Request processed in 7957us (8314us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787692.970210:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 209 00000100:00100000:3.0:1785787692.978243:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787692.978283:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744872576 00000100:00100000:3.0:1785787692.978304:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744872576 00000100:00100000:3.0:1785787692.978362:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 59 00000100:00100000:3.0:1785787692.978371:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+57:11643:x1872533744872576:12345-192.168.203.53@tcp:35:bash.0 00000100:00100000:3.0:1785787692.978577:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+58:11643:x1872533744872576:12345-192.168.203.53@tcp:35:bash.0 Request processed in 206us (343us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1785787692.978585:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 59 00000100:00100000:2.0:1785787693.071212:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787693.071358:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744872704 00000100:00100000:3.0:1785787693.071367:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744872704 00000100:00100000:3.0:1785787693.071444:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 210 00000100:00100000:3.0:1785787693.071455:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907732ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+58:11649:x1872533744872704:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:3.0:1785787693.071477:0:9295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787693.071497:0:9295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e852e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd657 expref: -99 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787693.071558:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e852ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787693.071571:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e852ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787693.071587:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e852ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785787693.071643:0:9295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1785787693.071648:0:9295:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1785787693.071669:0:9295:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e852ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787693.071693:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e852e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd657 expref: 60 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787693.071729:0:9295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e852ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd657 expref: 59 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787693.071737:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff919059e3e900) 00010000:00010000:3.0:1785787693.071740:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785787693.071744:0:9295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f903000, rc 0) 00000100:00100000:3.0:1785787693.071800:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907732ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+59:11649:x1872533744872704:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 347us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787693.071807:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 210 00000100:00080000:2.0:1785787693.072242:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785787693.088719:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787693.088810:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744872832 00000100:00100000:0.0:1785787693.088869:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744872832 00000100:00100000:0.0:1785787693.088924:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 211 00000100:00100000:0.0:1785787693.088934:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+59:11649:x1872533744872832:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:0.0:1785787693.088955:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787693.088973:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e852f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd65e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.089029:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e852fc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.089042:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e852fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.089053:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e852fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.089065:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e85303 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.089071:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e85303 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.089077:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e85303 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.089176:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e8530a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.089184:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e8530a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.089190:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e8530a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785787693.089227:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1785787693.089231:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1785787693.089249:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e8530a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.089261:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e8530a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.089408:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e852fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.089416:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e852fc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.089423:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e852fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.089428:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919052f5f800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1785787693.089432:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e852fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.089438:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e852fc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.089449:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff919059e3e900) 00010000:00010000:0.0:1785787693.089452:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785787693.089456:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e852fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.089462:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e852fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.089486:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e85303 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.089493:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e85303 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.089499:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e85303 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.089505:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919052f5ee00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1785787693.089507:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e85303 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.089513:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e85303 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.089521:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff919059e3e200) 00010000:00010000:0.0:1785787693.089524:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785787693.089527:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e85303 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.089533:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e85303 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.089562:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e852f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd65e expref: 61 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.089574:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e8530a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd65e expref: 60 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.089592:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91905685ff00) 00010000:00010000:0.0:1785787693.089594:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785787693.089596:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919052f5fc00, rc 0) 00000100:00100000:0.0:1785787693.089652:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+60:11649:x1872533744872832:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 720us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787693.089658:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 211 00000100:00100000:1.0:1785787693.100207:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787693.100294:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744873088 00000100:00100000:3.0:1785787693.100303:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744873088 00000100:00100000:3.0:1785787693.100357:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 212 00000100:00100000:3.0:1785787693.100366:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919048781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+60:11649:x1872533744873088:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:3.0:1785787693.100386:0:9295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787693.100416:0:9295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e85311 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd665 expref: -99 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787693.100504:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e85318 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787693.100517:0:9295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e852e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd650 expref: 61 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787693.100526:0:9295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e8530a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd65e expref: 61 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787693.100551:0:9295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e85318 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787693.100593:0:9295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e8530a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd65e expref: 61 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787693.100607:0:9295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e8530a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd65e expref: 61 pid: 5820 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787693.100620:0:9295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907be0e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9295:1872533770032512:192.168.203.53@tcp:104: 00010000:00010000:3.0:1785787693.100727:0:9295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e852e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd650 expref: 61 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787693.100737:0:9295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e852e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd650 expref: 61 pid: 5822 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787693.100745:0:9295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907be0f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9295:1872533770032640:192.168.203.53@tcp:104: 00000100:00100000:3.0:1785787693.100768:0:9295:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905064a180 going to sleep for 11 seconds 00000100:00100000:2.0:1785787693.111244:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787693.111367:0:11051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744873216 00000100:00100000:0.0:1785787693.111376:0:11051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744873216 00010000:00010000:0.0:1785787693.111421:0:11051:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e8530a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd65e expref: 62 pid: 5820 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787693.111462:0:11051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 79 00000100:00100000:0.0:1785787693.111471:0:11051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907732c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79280304-55c6-4698-bfc3-29d14648ba45+62:2391:x1872533744873216:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785787693.111485:0:11051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785787693.111491:0:11051:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e8530a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd65e expref: 62 pid: 5820 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.111503:0:11051:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e8530a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd65e expref: 62 pid: 5820 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.111522:0:11051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91905685ff00) 00010000:00010000:0.0:1785787693.111527:0:11051:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e85318 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.111535:0:11051:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e85318 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.111558:0:11051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785787693.111623:0:11051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907732c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79280304-55c6-4698-bfc3-29d14648ba45+62:2391:x1872533744873216:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 152us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787693.111631:0:11051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 79 00000100:00100000:1.0:1785787693.113179:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00010000:00010000:3.0:1785787693.113273:0:9295:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.53@tcp) returned -22 from blocking AST (req@00000000b8578dda x1872533770032512) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e8530a lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd65e expref: 61 pid: 5820 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787693.113290:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e8530a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd65e expref: 61 pid: 5820 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787693.113305:0:9295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907be0e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9295:1872533770032512:192.168.203.53@tcp:104: 00000100:00100000:3.0:1785787693.113329:0:9295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907be0f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9295:1872533770032640:192.168.203.53@tcp:104: 00010000:00010000:3.0:1785787693.113350:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91905685ff00) 00010000:00010000:3.0:1785787693.113355:0:9295:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e85318 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787693.113363:0:9295:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e85318 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787693.113371:0:9295:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e85318 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787693.113470:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744873344 00000100:00100000:0.0:1785787693.113476:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744873344 00010000:00010000:0.0:1785787693.113500:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e852e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd650 expref: 61 pid: 5822 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787693.113533:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 80 00000100:00100000:0.0:1785787693.113541:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051466450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79280304-55c6-4698-bfc3-29d14648ba45+61:2390:x1872533744873344:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785787693.113552:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785787693.113558:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e852e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd650 expref: 61 pid: 5822 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.113569:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e852e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd650 expref: 61 pid: 5822 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.113593:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91908206ae00/0xe2c2ff68a6e852e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd650 expref: 61 pid: 5822 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.113606:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91905685ff00) 00010000:00010000:0.0:1785787693.113609:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e85318 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.113617:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e85318 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.113634:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e85318 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.113662:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785787693.113705:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051466450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79280304-55c6-4698-bfc3-29d14648ba45+60:2390:x1872533744873344:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 164us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787693.113713:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 80 00010000:00010000:1.0:1785787693.114061:0:9295:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e85318 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787693.114069:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e85318 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785787693.114086:0:9295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1785787693.114210:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e85311 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd665 expref: 61 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787693.114225:0:9295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e85318 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd665 expref: 60 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787693.114238:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91905685ff00) 00010000:00010000:1.0:1785787693.114240:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1785787693.114242:0:9295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f903800, rc 0) 00000100:00100000:1.0:1785787693.114287:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919048781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+60:11649:x1872533744873088:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 13923us (14089us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1785787693.114294:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 212 00000100:00100000:1.0:1785787693.131080:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787693.131167:0:11051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744873600 00000100:00100000:0.0:1785787693.131176:0:11051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744873600 00000100:00100000:0.0:1785787693.131235:0:11051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 17 00000100:00100000:0.0:1785787693.131243:0:11051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79280304-55c6-4698-bfc3-29d14648ba45+60:11649:x1872533744873600:12345-192.168.203.53@tcp:103:lfs.0 00010000:00010000:0.0:1785787693.131257:0:11051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785787693.131286:0:11051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a200/0xe2c2ff68a6e85277 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd63b expref: 60 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.131306:0:11051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91905685ff00) 00010000:00010000:0.0:1785787693.131310:0:11051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785787693.131364:0:11051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79280304-55c6-4698-bfc3-29d14648ba45+59:11649:x1872533744873600:12345-192.168.203.53@tcp:103:lfs.0 Request processed in 122us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787693.131372:0:11051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 17 00000100:00100000:2.0:1785787693.133126:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787693.133199:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744873728 00000100:00100000:3.0:1785787693.133206:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744873728 00000100:00100000:3.0:1785787693.133243:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 213 00000100:00100000:3.0:1785787693.133251:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907732fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+59:11649:x1872533744873728:12345-192.168.203.53@tcp:58:lfs.0 00010000:00010000:3.0:1785787693.133396:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e85326 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787693.133423:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e85326 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787693.133434:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e85326 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1785787693.133653:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1785787693.133722:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907732fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+59:11649:x1872533744873728:12345-192.168.203.53@tcp:58:lfs.0 Request processed in 471us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787693.133730:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 213 00000100:00100000:2.0:1785787693.135534:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787693.136666:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744873856 00000100:00100000:0.0:1785787693.136673:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744873856 00000100:00100000:0.0:1785787693.136722:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 214 00000100:00100000:0.0:1785787693.136732:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907732ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+59:11649:x1872533744873856:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:0.0:1785787693.136748:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787693.136765:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e8532d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd66c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.136823:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e85326 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.136849:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e8532d lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd66c expref: 60 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.136867:0:5821:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e85326 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.136878:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e8532d lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd66c expref: 60 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.136891:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91905685ff00) 00010000:00010000:0.0:1785787693.136893:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1785787693.136897:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e8532d lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd66c expref: 60 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.136905:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919052f5e400, rc 0) 00000100:00100000:0.0:1785787693.136954:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907732ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+60:11649:x1872533744873856:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 223us (1422us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787693.136961:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 214 00000100:00100000:2.0:1785787693.491058:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076eef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770032768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785787693.491128:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787693.491364:0:6621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770032768 00000100:00100000:1.0:1785787693.491372:0:6621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770032768 00000100:00100000:1.0:1785787693.491432:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1785787693.491441:0:6621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907732c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3333:x1872533770032768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785787693.491463:0:6621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785787693.491506:0:6621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907732c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3333:x1872533770032768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787693.491513:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1785787693.491691:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076eef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770032768:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1785787693.554979:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1785787693.748948:0:11564:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1785787693.748956:0:11564:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1785787693.748990:0:11564:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1785787693.748996:0:11564:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1785787693.749118:0:11564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076eedc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11564:1872533770032896:192.168.203.53@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1785787693.749221:0:11564:0:(client.c:2702:ptlrpc_set_wait()) set ffff91907fe409c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785787693.751879:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787693.751961:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744873984 00000100:00100000:0.0:1785787693.751971:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744873984 00000100:00100000:0.0:1785787693.752022:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 215 00000100:00100000:0.0:1785787693.752033:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+61:11651:x1872533744873984:12345-192.168.203.53@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1785787693.752065:0:5822:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1785787693.752176:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+61:11651:x1872533744873984:12345-192.168.203.53@tcp:53:lhsmtool_posix.0 Request processed in 145us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787693.752184:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 215 00000100:00100000:1.0:1785787693.753732:0:11564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076eedc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11564:1872533770032896:192.168.203.53@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1785787693.755330:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787693.756147:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744874112 00000100:00100000:0.0:1785787693.756157:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744874112 00000100:00100000:0.0:1785787693.756262:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 216 00000100:00100000:0.0:1785787693.756273:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907732ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+60:11651:x1872533744874112:12345-192.168.203.53@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1785787693.756339:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e85334 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.756355:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e85334 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.756367:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e85334 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.756381:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f400/0xe2c2ff68a6e8533b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.756388:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f400/0xe2c2ff68a6e8533b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.756406:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f400/0xe2c2ff68a6e8533b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.756426:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f000/0xe2c2ff68a6e85342 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.756434:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f000/0xe2c2ff68a6e85342 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.756440:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f000/0xe2c2ff68a6e85342 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785787693.756484:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1785787693.756488:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1785787693.756500:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f000/0xe2c2ff68a6e85342 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.756510:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e85334 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.756516:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e85334 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.756523:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e85334 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.756529:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919052f5f800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1785787693.756533:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e85334 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.756540:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e85334 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.756551:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9190481f9400) 00010000:00010000:0.0:1785787693.756554:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785787693.756558:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e85334 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.756564:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f800/0xe2c2ff68a6e85334 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.756576:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f400/0xe2c2ff68a6e8533b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.756592:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f400/0xe2c2ff68a6e8533b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.756598:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f400/0xe2c2ff68a6e8533b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.756603:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919052f5f400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1785787693.756606:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f400/0xe2c2ff68a6e8533b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.756613:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f400/0xe2c2ff68a6e8533b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.756621:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff919059e3e200) 00010000:00010000:0.0:1785787693.756623:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785787693.756626:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f400/0xe2c2ff68a6e8533b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.756632:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f400/0xe2c2ff68a6e8533b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.756646:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f000/0xe2c2ff68a6e85342 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.756652:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f000/0xe2c2ff68a6e85342 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.756658:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f000/0xe2c2ff68a6e85342 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.756662:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919052f5f000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1785787693.756670:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f000/0xe2c2ff68a6e85342 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.756676:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f000/0xe2c2ff68a6e85342 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.756683:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91905685ff00) 00010000:00010000:0.0:1785787693.756685:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785787693.756688:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f000/0xe2c2ff68a6e85342 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.756693:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f000/0xe2c2ff68a6e85342 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787693.756761:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907732ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+60:11651:x1872533744874112:12345-192.168.203.53@tcp:34:lhsmtool_posix.0 Request processed in 489us (1433us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787693.756768:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 216 00000100:00100000:1.0:1785787693.763727:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787693.763872:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744874368 00000100:00100000:0.0:1785787693.763881:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744874368 00000100:00100000:0.0:1785787693.763934:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 217 00000100:00100000:0.0:1785787693.763942:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+60:11651:x1872533744874368:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1785787693.763960:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787693.763979:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e800/0xe2c2ff68a6e85349 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd673 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.764061:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fa00/0xe2c2ff68a6e85350 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.764074:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fa00/0xe2c2ff68a6e85350 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.764912:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fa00/0xe2c2ff68a6e85350 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785787693.764925:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1785787693.765015:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fa00/0xe2c2ff68a6e85350 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.765022:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fa00/0xe2c2ff68a6e85350 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.765029:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fa00/0xe2c2ff68a6e85350 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.765035:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919052f5fa00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1785787693.765039:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fa00/0xe2c2ff68a6e85350 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.765046:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fa00/0xe2c2ff68a6e85350 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.765059:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91905685ff00) 00010000:00010000:0.0:1785787693.765062:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1785787693.765066:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fa00/0xe2c2ff68a6e85350 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.765072:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fa00/0xe2c2ff68a6e85350 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.765116:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e800/0xe2c2ff68a6e85349 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd673 expref: 62 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.765139:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9190481f9400) 00010000:00010000:0.0:1785787693.765142:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1785787693.765146:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e800/0xe2c2ff68a6e85349 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd673 expref: 62 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.765156:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919052f5e800, rc 0) 00000100:00100000:0.0:1785787693.765214:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+61:11651:x1872533744874368:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 1272us (1494us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1785787693.765222:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 217 00000100:00100000:3.0:1785787693.773815:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787693.774227:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744874496 00000100:00100000:1.0:1785787693.774236:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744874496 00000100:00100000:1.0:1785787693.774292:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 218 00000100:00100000:1.0:1785787693.774300:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+61:11651:x1872533744874496:12345-192.168.203.53@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1785787693.774332:0:9295:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1785787693.774440:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+61:11651:x1872533744874496:12345-192.168.203.53@tcp:53:lhsmtool_posix.0 Request processed in 140us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787693.774447:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 218 00000100:00100000:2.0:1785787693.785507:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787693.785776:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744874752 00000100:00100000:3.0:1785787693.785786:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744874752 00000100:00100000:3.0:1785787693.785878:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 219 00000100:00100000:3.0:1785787693.785888:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907732d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+61:11651:x1872533744874752:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785787693.785919:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787693.785923:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1785787693.785956:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e852ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd657 expref: 61 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787693.785976:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff919059e3e900) 00010000:00010000:3.0:1785787693.785980:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785787693.785992:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e8535e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd67a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785787693.786418:0:5820:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:3.0:1785787693.786607:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e85365 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787693.786620:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e85365 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787693.786630:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e85365 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787693.786679:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e8535e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd67a expref: 63 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787693.786693:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e85365 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd67a expref: 62 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787693.786712:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff919055acd900) 00010000:00010000:3.0:1785787693.786715:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785787693.786718:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f902800, rc 0) 00000100:00100000:3.0:1785787693.786776:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907732d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+62:11651:x1872533744874752:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 890us (1277us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1785787693.786784:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 219 00000100:00100000:3.0:1785787693.802531:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787693.802724:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744875008 00000100:00100000:1.0:1785787693.802733:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744875008 00000100:00100000:1.0:1785787693.802786:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 220 00000100:00100000:1.0:1785787693.802796:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+62:11651:x1872533744875008:12345-192.168.203.53@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1785787693.802889:0:9295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785787693.802916:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902800/0xe2c2ff68a6e85365 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd67a expref: 62 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787693.802935:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff919055acd900) 00010000:00010000:1.0:1785787693.802946:0:9295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785787693.802965:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b600/0xe2c2ff68a6e85373 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787693.802978:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b600/0xe2c2ff68a6e85373 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787693.802987:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b600/0xe2c2ff68a6e85373 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787693.803000:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e8537a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x966d4479 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787693.803008:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e8537a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x966d4479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787693.803027:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e8537a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x966d4479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787693.803093:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b600/0xe2c2ff68a6e85373 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787693.803100:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b600/0xe2c2ff68a6e85373 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787693.803108:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b600/0xe2c2ff68a6e85373 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787693.803114:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91908206b600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787693.803118:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b600/0xe2c2ff68a6e85373 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787693.803126:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b600/0xe2c2ff68a6e85373 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787693.803144:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff919059e3e900) 00010000:00010000:1.0:1785787693.803147:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785787693.803151:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b600/0xe2c2ff68a6e85373 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787693.803157:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91908206b600/0xe2c2ff68a6e85373 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787693.803168:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e8537a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x966d4479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787693.803174:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e8537a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x966d4479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787693.803186:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e8537a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x966d4479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787693.803192:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91908206a400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787693.803196:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e8537a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x966d4479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787693.803202:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e8537a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x966d4479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787693.803209:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x966d4479 (ffff91905685f600) 00010000:00010000:1.0:1785787693.803212:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785787693.803215:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e8537a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x966d4479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787693.803221:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e8537a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x966d4479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787693.803296:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+61:11651:x1872533744875008:12345-192.168.203.53@tcp:36:lhsmtool_posix.0 Request processed in 500us (775us total) trans 0 rc -2/-2 00000100:00100000:1.0:1785787693.803303:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 220 00000100:00100000:2.0:1785787693.809666:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787693.809744:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744875136 00000100:00100000:0.0:1785787693.809754:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744875136 00000100:00100000:0.0:1785787693.809814:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 221 00000100:00100000:0.0:1785787693.809823:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907732e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+61:11651:x1872533744875136:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1785787693.809857:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787693.809878:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e800/0xe2c2ff68a6e85381 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd681 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.809923:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fa00/0xe2c2ff68a6e85388 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.809944:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fa00/0xe2c2ff68a6e85388 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.809954:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fa00/0xe2c2ff68a6e85388 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.810056:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e800/0xe2c2ff68a6e85381 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd681 expref: 63 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.810090:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fa00/0xe2c2ff68a6e85388 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd681 expref: 62 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.810099:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff919059e3e200) 00010000:00010000:0.0:1785787693.810102:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1785787693.810105:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919052f5fa00, rc 0) 00000100:00100000:0.0:1785787693.810162:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907732e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+62:11651:x1872533744875136:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 340us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787693.810169:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 221 00000100:00100000:2.0:1785787693.822340:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787693.826679:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744875392 00000100:00100000:1.0:1785787693.826693:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744875392 00000100:00100000:1.0:1785787693.826789:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 222 00000100:00100000:1.0:1785787693.826801:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907732ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+62:11651:x1872533744875392:12345-192.168.203.53@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1785787693.826898:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e8538f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787693.826923:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e8538f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787693.826955:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e8538f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1785787693.827193:0:9295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:1.0:1785787693.828560:0:9295:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 481072730481ns, next at 482072726066ns, rc = 0 00000004:00010000:1.0:1785787693.828680:0:9295:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000011f6d35 reply state 00000000b8b4cccc transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e8538f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787693.828692:0:9295:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785787693.828889:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907732ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+64:11651:x1872533744875392:12345-192.168.203.53@tcp:36:lhsmtool_posix.0 Request processed in 2088us (6553us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1785787693.828898:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 222 00000100:00100000:2.0:1785787693.847442:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00010000:00010000:1.0:1785787693.848029:0:3320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e8538f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787693.848044:0:3320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e8538f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787693.848052:0:3320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e8538f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787693.848059:0:3320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91908206a400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787693.848063:0:3320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e8538f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787693.848072:0:3320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e8538f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787693.848088:0:3320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff919059e3e200) 00010000:00010000:1.0:1785787693.848091:0:3320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1785787693.848110:0:3320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e8538f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787693.848117:0:3320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e8538f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787693.848210:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744875520 00000100:00100000:0.0:1785787693.848219:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744875520 00000100:00100000:0.0:1785787693.848278:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 223 00000100:00100000:0.0:1785787693.848288:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907732e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+63:11651:x1872533744875520:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1785787693.848310:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787693.848327:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e800/0xe2c2ff68a6e85396 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd688 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.848385:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e800/0xe2c2ff68a6e85396 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd688 expref: 64 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.848412:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e800/0xe2c2ff68a6e85396 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd688 expref: 64 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.848431:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff919059e3e200) 00010000:00010000:0.0:1785787693.848434:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1785787693.848444:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919052f5e800, rc 0) 00000100:00100000:0.0:1785787693.848502:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907732e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+64:11651:x1872533744875520:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 215us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787693.848509:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 223 00000100:00100000:2.0:1785787693.852592:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787693.852937:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744875648 00000100:00100000:0.0:1785787693.852947:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744875648 00000100:00100000:0.0:1785787693.853009:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 62 00000100:00100000:0.0:1785787693.853020:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907732f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+9:2390:x1872533744875648:12345-192.168.203.53@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1785787693.853548:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907732f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+10:2390:x1872533744875648:12345-192.168.203.53@tcp:2:lhsmtool_posix.0 Request processed in 528us (962us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1785787693.853556:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 62 00000100:00080000:3.0:1785787693.854123:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785787693.873697:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787693.873778:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744875904 00000100:00100000:3.0:1785787693.873789:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744875904 00000100:00100000:3.0:1785787693.873883:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 60 00000100:00100000:3.0:1785787693.873894:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907732df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+64:11651:x1872533744875904:12345-192.168.203.53@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1785787693.874545:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907732df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+65:11651:x1872533744875904:12345-192.168.203.53@tcp:35:lhsmtool_posix.0 Request processed in 651us (855us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1785787693.874554:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 60 00000100:00100000:1.0:1785787693.887792:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787693.888130:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744876160 00000100:00100000:0.0:1785787693.888150:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744876160 00000100:00100000:0.0:1785787693.888214:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 224 00000100:00100000:0.0:1785787693.888225:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+65:11651:x1872533744876160:12345-192.168.203.53@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1785787693.888346:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+65:11651:x1872533744876160:12345-192.168.203.53@tcp:57:lhsmtool_posix.0 Request processed in 123us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787693.888354:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 224 00000100:00100000:3.0:1785787693.905560:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787693.906232:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744876288 00000100:00100000:0.0:1785787693.906242:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744876288 00000100:00100000:0.0:1785787693.906383:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 225 00000100:00100000:0.0:1785787693.906402:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+65:11651:x1872533744876288:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1785787693.906422:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787693.906442:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f000/0xe2c2ff68a6e8539d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd68f expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.906538:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f400/0xe2c2ff68a6e853a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.906550:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f400/0xe2c2ff68a6e853a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.906561:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f400/0xe2c2ff68a6e853a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785787693.906593:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1785787693.906609:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f400/0xe2c2ff68a6e853a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.906635:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f000/0xe2c2ff68a6e8539d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd68f expref: 67 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.906652:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f400/0xe2c2ff68a6e853a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd68f expref: 66 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.906661:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff919059e3e200) 00010000:00010000:0.0:1785787693.906665:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1785787693.906668:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919052f5f400, rc 0) 00000100:00100000:0.0:1785787693.906728:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+66:11651:x1872533744876288:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 337us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787693.906736:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 225 00000100:00100000:3.0:1785787693.909242:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787693.909350:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744876416 00000100:00100000:1.0:1785787693.909358:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744876416 00000100:00100000:1.0:1785787693.909412:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 63 00000100:00100000:1.0:1785787693.909421:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:79280304-55c6-4698-bfc3-29d14648ba45+10:2391:x1872533744876416:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1785787693.909437:0:9394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787693.909453:0:9394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000641053ef/0xe2c2ff68a6e853ab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd696 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1785787693.909476:0:9394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a70f52e, blocks: 0x1 00010000:00010000:1.0:1785787693.909492:0:9394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=481s v=(0 0) 00010000:00010000:1.0:1785787693.909496:0:9394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785787693.909504:0:9394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000641053ef/0xe2c2ff68a6e853ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd696 expref: 11 pid: 9394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787693.909520:0:9394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000641053ef/0xe2c2ff68a6e853ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd696 expref: 11 pid: 9394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787693.909531:0:9394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91908206a400, rc 0) 00000100:00100000:1.0:1785787693.909574:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:79280304-55c6-4698-bfc3-29d14648ba45+11:2391:x1872533744876416:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 154us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787693.909580:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 63 00000100:00100000:2.0:1785787693.920115:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787693.920231:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744876672 00000100:00100000:0.0:1785787693.920241:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744876672 00000100:00100000:0.0:1785787693.920308:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 226 00000100:00100000:0.0:1785787693.920333:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907732c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+66:11651:x1872533744876672:12345-192.168.203.53@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1785787693.920445:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907732c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+66:11651:x1872533744876672:12345-192.168.203.53@tcp:57:lhsmtool_posix.0 Request processed in 114us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787693.920453:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 226 00000100:00100000:0.0:1785787693.938635:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787693.938733:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744876800 00000100:00100000:1.0:1785787693.938743:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744876800 00000100:00100000:1.0:1785787693.938795:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 64 00000100:00100000:1.0:1785787693.938804:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:79280304-55c6-4698-bfc3-29d14648ba45+11:11651:x1872533744876800:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1785787693.938822:0:6619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787693.938889:0:6619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e2a4731/0xe2c2ff68a6e853b2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd69d expref: -99 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787693.938921:0:6619:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000641053ef/0xe2c2ff68a6e853ab lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd696 expref: 12 pid: 9394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787693.938929:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785787693.938933:0:6619:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785787693.938938:0:6619:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e2a4731/0xe2c2ff68a6e853b2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd69d expref: 12 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787693.938971:0:6619:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000641053ef/0xe2c2ff68a6e853ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd696 expref: 12 pid: 9394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787693.938984:0:6619:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000641053ef/0xe2c2ff68a6e853ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd696 expref: 12 pid: 9394 timeout: 581 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787693.938999:0:6619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076eeed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6619:1872533770033024:192.168.203.53@tcp:104: 00000100:00100000:1.0:1785787693.939093:0:6619:0:(client.c:2702:ptlrpc_set_wait()) set ffff91907fe409c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785787693.943572:0:6619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076eeed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6619:1872533770033024:192.168.203.53@tcp:104: 00010000:00010000:1.0:1785787693.943608:0:6619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006e2a4731/0xe2c2ff68a6e853b2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd69d expref: 12 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787693.943641:0:6619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91908206b000, rc 0) 00000100:00100000:1.0:1785787693.943692:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:79280304-55c6-4698-bfc3-29d14648ba45+12:11651:x1872533744876800:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 4888us (5065us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787693.943701:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 64 00000100:00100000:3.0:1785787693.944548:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787693.944614:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744876928 00000100:00100000:0.0:1785787693.944621:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744876928 00010000:00010000:0.0:1785787693.944653:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000641053ef/0xe2c2ff68a6e853ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd696 expref: 12 pid: 9394 timeout: 581 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787693.944685:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 81 00000100:00100000:0.0:1785787693.944693:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907be0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79280304-55c6-4698-bfc3-29d14648ba45+12:2391:x1872533744876928:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785787693.944706:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785787693.944737:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000641053ef/0xe2c2ff68a6e853ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd696 expref: 12 pid: 9394 timeout: 581 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.944750:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000641053ef/0xe2c2ff68a6e853ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd696 expref: 12 pid: 9394 timeout: 581 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.944770:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000641053ef/0xe2c2ff68a6e853ab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd696 expref: 12 pid: 9394 timeout: 581 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.944784:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785787693.944788:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785787693.944795:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006e2a4731/0xe2c2ff68a6e853b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd69d expref: 11 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.944812:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e2a4731/0xe2c2ff68a6e853b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd69d expref: 11 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787693.944881:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006e2a4731/0xe2c2ff68a6e853b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd69d expref: 11 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787693.944894:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fe16680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5806:1872533770033152:192.168.203.53@tcp:105: 00000100:00100000:0.0:1785787693.944951:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190770abd80 going to sleep for 11 seconds 00000100:00100000:0.0:1785787693.949613:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787693.949672:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744877056 00000100:00100000:2.0:1785787693.949681:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744877056 00002000:00100000:2.0:1785787693.949728:0:6624:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff91907fe14a80 x1872533744877056/t0(0) o4->79280304-55c6-4698-bfc3-29d14648ba45@192.168.203.53@tcp:549/0 lens 504/0 e 0 to 0 dl 1785787704 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785787693.949739:0:6624:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91907fe14a80 with x1872533744877056 ext(0->12) 00002000:00010000:2.0:1785787693.949756:0:6624:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91907fe14a80 00000100:00100000:1.0:1785787693.949878:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fe16680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5806:1872533770033152:192.168.203.53@tcp:105: 00010000:00010000:1.0:1785787693.949899:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785787693.949997:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907be0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79280304-55c6-4698-bfc3-29d14648ba45+12:2391:x1872533744876928:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 5304us (5450us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787693.950007:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 81 00000100:00100000:2.0:1785787693.951479:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 6 00000100:00100000:2.0:1785787693.951493:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:79280304-55c6-4698-bfc3-29d14648ba45+11:2390:x1872533744877056:12345-192.168.203.53@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1785787693.951912:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:79280304-55c6-4698-bfc3-29d14648ba45+13:2390:x1872533744877056:12345-192.168.203.53@tcp:4:lhsmtool_posix.0 Request processed in 423us (2306us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1785787693.951920:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 6 00002000:00100000:2.0:1785787693.952067:0:6624:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff91907fe14a80 x1872533744877056/t4294967320(0) o4->79280304-55c6-4698-bfc3-29d14648ba45@192.168.203.53@tcp:549/0 lens 504/448 e 0 to 0 dl 1785787704 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785787693.952077:0:6624:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91907fe14a80 with x1872533744877056 ext(0->12) 00002000:00010000:2.0:1785787693.952083:0:6624:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91907fe14a80 00000100:00100000:3.0:1785787693.960821:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787693.961135:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744877184 00000100:00100000:0.0:1785787693.961144:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744877184 00000100:00100000:0.0:1785787693.961206:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 227 00000100:00100000:0.0:1785787693.961215:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905c5f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+66:11651:x1872533744877184:12345-192.168.203.53@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1785787694.137820:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905c5f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+66:11651:x1872533744877184:12345-192.168.203.53@tcp:44:lhsmtool_posix.0 Request processed in 176596us (176998us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787694.137856:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 227 00000001:00080000:2.0:1785787694.138031:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967503 is committed 00000020:00080000:2.0:1785787694.138052:0:5843:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9190770ab840 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1785787694.138056:0:5843:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff91904e896e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9190770ab9c0 00000020:00080000:2.0:1785787694.138059:0:5843:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff91904e896200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91907bbc8800 00000001:00080000:2.0:1785787694.138085:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:2.0:1785787694.138090:0:5843:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000020:00080000:2.0:1785787694.138126:0:5843:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9190507ea6c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1785787694.138130:0:5843:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9190474e3a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9190507eacc0 00000020:00080000:2.0:1785787694.138133:0:5843:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9190474e3600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9190776cc400 00000001:00080000:2.0:1785787694.138153:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:2.0:1785787694.138174:0:5843:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:2.0:1785787694.138189:0:5843:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000100:00100000:2.0:1785787694.138379:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907732d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770033280:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1785787694.138437:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787694.138516:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907732d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770033408:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1785787694.138553:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787694.138575:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785787694.138581:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907732f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770033536:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1785787694.138603:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787694.138634:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770033280 00000100:00100000:2.0:1785787694.138642:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770033280 00000100:00100000:2.0:1785787694.138683:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770033408 00000100:00100000:2.0:1785787694.138687:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770033408 00000100:00100000:2.0:1785787694.138698:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770033536 00000100:00100000:2.0:1785787694.138700:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770033536 00000100:00100000:2.0:1785787694.138716:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1785787694.138724:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907732c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3334:x1872533770033280:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1785787694.138745:0:9394:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:2.0:1785787694.138766:0:9394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078014ab1/0xe2c2ff68a6e853b9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.138785:0:9394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f702a1a6/0xe2c2ff68a6e8517b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5fc expref: 12 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.138794:0:9394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1785787694.138799:0:9394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785787694.138803:0:9394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078014ab1/0xe2c2ff68a6e853b9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.138848:0:9394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f702a1a6/0xe2c2ff68a6e8517b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5fc expref: 12 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.138873:0:9394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f702a1a6/0xe2c2ff68a6e8517b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5fc expref: 12 pid: 6618 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787694.138884:0:9394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190771edf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9394:1872533770033664:192.168.203.53@tcp:104: 00000100:00100000:2.0:1785787694.138928:0:9394:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190507eab40 going to sleep for 11 seconds 00000100:00100000:2.0:1785787694.138944:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1785787694.138952:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190771ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3335:x1872533770033408:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1785787694.139072:0:6617:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1785787694.139076:0:6617:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1785787694 00002000:00010000:2.0:1785787694.139079:0:6617:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1785787694.139081:0:6617:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1785787694 -> 1785787694 00002000:00010000:2.0:1785787694.139083:0:6617:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1785787694.139117:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190771ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3335:x1872533770033408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 166us (563us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1785787694.139125:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1785787694.139139:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1785787694.139146:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190771ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3335:x1872533770033536:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1785787694.139157:0:6617:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:2.0:1785787694.139177:0:6617:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a70f52c, atime: 0x6a70f52c, ctime: 0x6a70f52c, blocks: 0xb 00010000:00010000:2.0:1785787694.139182:0:6617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bd992d8/0xe2c2ff68a6e853c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.139191:0:6617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1785787694.139194:0:6617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785787694.139205:0:6617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007bd992d8/0xe2c2ff68a6e853c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.139219:0:6617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007bd992d8/0xe2c2ff68a6e853c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.139228:0:6617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bd992d8/0xe2c2ff68a6e853c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.139235:0:6617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007bd992d8/0xe2c2ff68a6e853c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.139251:0:6617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1785787694.139721:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190771ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3335:x1872533770033536:12345-0@lo:6:osp-syn-0-0.0 Request processed in 575us (1116us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1785787694.139728:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1785787694.139752:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1785787694.139755:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1785787694.139765:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785787694.139769:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007bd992d8/0xe2c2ff68a6e853c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.139777:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677d600 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785787694.139781:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007bd992d8/0xe2c2ff68a6e853c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.139790:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007bd992d8/0xe2c2ff68a6e853c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.139812:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007bd992d8/0xe2c2ff68a6e853c0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.139819:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007bd992d8/0xe2c2ff68a6e853c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.139854:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787694.139856:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787694.139858:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1785787694.139885:0:3335:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91907732f800/2, rc 0, transno 4294967310 00000100:00100000:2.0:1785787694.139890:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907732f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770033536:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1785787694.139902:0:3335:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91907732d180/2, rc 0, transno 4294967321 00000100:00100000:2.0:1785787694.139906:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907732d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770033408:0@lo:2:osp-syn-1-0.0 00000020:00080000:3.0:1785787694.140955:0:5854:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1785787694.141101:0:5854:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000001:00080000:0.0:1785787694.144494:0:6642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:0.0:1785787694.144508:0:6642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:3.0:1785787694.145694:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787694.145774:0:9394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190771edf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9394:1872533770033664:192.168.203.53@tcp:104: 00010000:00010000:2.0:1785787694.145800:0:9394:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000078014ab1/0xe2c2ff68a6e853b9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787694.146095:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744877312 00000100:00100000:0.0:1785787694.146103:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744877312 00000100:00100000:0.0:1785787694.146161:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 68 00000100:00100000:0.0:1785787694.146171:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:79280304-55c6-4698-bfc3-29d14648ba45+13:2389:x1872533744877312:12345-192.168.203.53@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1785787694.157364:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787694.157953:0:11051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744877440 00000100:00100000:1.0:1785787694.157963:0:11051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744877440 00010000:00010000:1.0:1785787694.158001:0:11051:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f702a1a6/0xe2c2ff68a6e8517b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5fc expref: 14 pid: 6618 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787694.158044:0:11051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 82 00000100:00100000:1.0:1785787694.158053:0:11051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79280304-55c6-4698-bfc3-29d14648ba45+14:2390:x1872533744877440:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785787694.158066:0:11051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785787694.158071:0:11051:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f702a1a6/0xe2c2ff68a6e8517b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5fc expref: 14 pid: 6618 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787694.158084:0:11051:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f702a1a6/0xe2c2ff68a6e8517b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5fc expref: 14 pid: 6618 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787694.158104:0:11051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f702a1a6/0xe2c2ff68a6e8517b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5fc expref: 14 pid: 6618 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787694.158141:0:11051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1785787694.158146:0:11051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1785787694.158151:0:11051:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000078014ab1/0xe2c2ff68a6e853b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787694.158161:0:11051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078014ab1/0xe2c2ff68a6e853b9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787694.158189:0:11051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785787694.158236:0:11051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79280304-55c6-4698-bfc3-29d14648ba45+13:2390:x1872533744877440:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 184us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787694.158244:0:11051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 82 00010000:00010000:0.0:1785787694.162883:0:9394:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000078014ab1/0xe2c2ff68a6e853b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.162902:0:9394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078014ab1/0xe2c2ff68a6e853b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.162929:0:9394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078014ab1/0xe2c2ff68a6e853b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.162936:0:9394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078014ab1/0xe2c2ff68a6e853b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.162956:0:9394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1785787694.163504:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907732c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3334:x1872533770033280:12345-0@lo:6:osp-syn-1-0.0 Request processed in 24776us (25063us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1785787694.163514:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:1.0:1785787694.164136:0:11050:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785787694.164144:0:11050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078014ab1/0xe2c2ff68a6e853b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787694.164153:0:11050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677ce00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785787694.164157:0:11050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078014ab1/0xe2c2ff68a6e853b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787694.164166:0:11050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078014ab1/0xe2c2ff68a6e853b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787694.164183:0:11050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078014ab1/0xe2c2ff68a6e853b9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787694.164204:0:11050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078014ab1/0xe2c2ff68a6e853b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787694.164222:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787694.164224:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787694.164226:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1785787694.166763:0:3334:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91907732d880/2, rc 0, transno 4294967322 00000100:00100000:2.0:1785787694.166774:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907732d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770033280:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1785787694.250420:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:3.0:1785787694.250440:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:3.0:1785787694.250458:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:2.0:1785787694.250615:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:79280304-55c6-4698-bfc3-29d14648ba45+7:2389:x1872533744877312:12345-192.168.203.53@tcp:16:lhsmtool_posix.0 Request processed in 104440us (104921us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787694.250626:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 68 00000100:00100000:3.0:1785787694.257533:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787694.257866:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744877696 00000100:00100000:0.0:1785787694.257876:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744877696 00000100:00100000:0.0:1785787694.257924:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 228 00000100:00100000:0.0:1785787694.257933:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+20:11651:x1872533744877696:12345-192.168.203.53@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1785787694.257983:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785787694.258009:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f400/0xe2c2ff68a6e853a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd68f expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.258028:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff919059e3e200) 00010000:00010000:0.0:1785787694.258033:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785787694.258061:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fe00/0xe2c2ff68a6e853c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.258074:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fe00/0xe2c2ff68a6e853c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.258100:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fe00/0xe2c2ff68a6e853c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785787694.258334:0:5821:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d59ddd19 reply state 000000005dde3ddf transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fe00/0xe2c2ff68a6e853c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787694.258344:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785787694.259374:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+21:11651:x1872533744877696:12345-192.168.203.53@tcp:36:lhsmtool_posix.0 Request processed in 1439us (1847us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1785787694.259383:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 228 00000100:00100000:3.0:1785787694.267240:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00010000:00010000:2.0:1785787694.267442:0:3319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fe00/0xe2c2ff68a6e853c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.267468:0:3319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fe00/0xe2c2ff68a6e853c7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.267476:0:3319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fe00/0xe2c2ff68a6e853c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.267483:0:3319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919052f5fe00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787694.267487:0:3319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fe00/0xe2c2ff68a6e853c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.267495:0:3319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fe00/0xe2c2ff68a6e853c7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.267511:0:3319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff919059e3e200) 00010000:00010000:2.0:1785787694.267514:0:3319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787694.267518:0:3319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fe00/0xe2c2ff68a6e853c7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.267524:0:3319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fe00/0xe2c2ff68a6e853c7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787694.274106:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744877824 00000100:00100000:1.0:1785787694.274119:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744877824 00000100:00100000:0.0:1785787694.278690:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 69 00000100:00100000:0.0:1785787694.278707:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190776f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:79280304-55c6-4698-bfc3-29d14648ba45+7:2390:x1872533744877824:12345-192.168.203.53@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1785787694.278922:0:6619:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1785787694.278926:0:6619:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1785787694 -> 1785787693 00002000:00010000:0.0:1785787694.278928:0:6619:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1785787692 00002000:00010000:0.0:1785787694.278930:0:6619:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1785787694 -> 1785787693 00002000:00010000:0.0:1785787694.278933:0:6619:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1785787694.279045:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190776f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:79280304-55c6-4698-bfc3-29d14648ba45+8:2390:x1872533744877824:12345-192.168.203.53@tcp:2:lhsmtool_posix.0 Request processed in 343us (11813us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1785787694.279053:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 69 00000100:00100000:0.0:1785787694.288114:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787694.288197:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744878080 00000100:00100000:1.0:1785787694.288206:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744878080 00000100:00100000:1.0:1785787694.288262:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 229 00000100:00100000:1.0:1785787694.288272:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fe16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+20:11651:x1872533744878080:12345-192.168.203.53@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1785787694.288343:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a000/0xe2c2ff68a6e853ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787694.288359:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fa00/0xe2c2ff68a6e85388 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd681 expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787694.288367:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a000/0xe2c2ff68a6e853ce lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787694.288409:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fa00/0xe2c2ff68a6e85388 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd681 expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787694.288433:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fa00/0xe2c2ff68a6e85388 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd681 expref: 20 pid: 5822 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787694.288467:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076eeed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5820:1872533770033792:192.168.203.53@tcp:104: 00000100:00100000:1.0:1785787694.288555:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff91907fe409c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785787694.293338:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787694.293515:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744878208 00000100:00100000:0.0:1785787694.293524:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744878208 00010000:00010000:0.0:1785787694.293561:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fa00/0xe2c2ff68a6e85388 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd681 expref: 21 pid: 5822 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787694.293622:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 83 00000100:00100000:0.0:1785787694.293632:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076edf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79280304-55c6-4698-bfc3-29d14648ba45+21:2391:x1872533744878208:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785787694.293645:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785787694.293652:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fa00/0xe2c2ff68a6e85388 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd681 expref: 21 pid: 5822 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.293664:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fa00/0xe2c2ff68a6e85388 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd681 expref: 21 pid: 5822 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.293686:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff919059e3e200) 00010000:00010000:0.0:1785787694.293691:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a000/0xe2c2ff68a6e853ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.293701:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a000/0xe2c2ff68a6e853ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.293708:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a000/0xe2c2ff68a6e853ce lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.293726:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785787694.293772:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076edf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79280304-55c6-4698-bfc3-29d14648ba45+21:2391:x1872533744878208:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 140us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787694.293779:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 83 00010000:00010000:1.0:1785787694.294015:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fa00/0xe2c2ff68a6e85388 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd681 expref: 20 pid: 5822 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787694.294031:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076eeed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5820:1872533770033792:192.168.203.53@tcp:104: 00010000:00010000:1.0:1785787694.294052:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a000/0xe2c2ff68a6e853ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787694.294061:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a000/0xe2c2ff68a6e853ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787694.294067:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a000/0xe2c2ff68a6e853ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787694.294094:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a000/0xe2c2ff68a6e853ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787694.294101:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a000/0xe2c2ff68a6e853ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787694.294108:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a000/0xe2c2ff68a6e853ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787694.294115:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91908206a000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787694.294119:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a000/0xe2c2ff68a6e853ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787694.294148:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a000/0xe2c2ff68a6e853ce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787694.294158:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff919059e3e200) 00010000:00010000:1.0:1785787694.294160:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1785787694.294165:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a000/0xe2c2ff68a6e853ce lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787694.294171:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a000/0xe2c2ff68a6e853ce lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787694.294220:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fe16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+19:11651:x1872533744878080:12345-192.168.203.53@tcp:55:lhsmtool_posix.0 Request processed in 5949us (6114us total) trans 0 rc -22/-22 00000100:00100000:1.0:1785787694.294227:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 229 00000100:00100000:3.0:1785787694.304659:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787694.304752:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744878336 00000100:00100000:0.0:1785787694.304762:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744878336 00000100:00100000:0.0:1785787694.304815:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 70 00000100:00100000:0.0:1785787694.304824:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:79280304-55c6-4698-bfc3-29d14648ba45+8:2390:x1872533744878336:12345-192.168.203.53@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1785787694.304914:0:9394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000250f5a6e/0xe2c2ff68a6e853d5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.304933:0:9394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006e2a4731/0xe2c2ff68a6e853b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd69d expref: 8 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.304941:0:9394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785787694.304946:0:9394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1785787694.304950:0:9394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000250f5a6e/0xe2c2ff68a6e853d5 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.304984:0:9394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006e2a4731/0xe2c2ff68a6e853b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd69d expref: 8 pid: 6619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.304998:0:9394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006e2a4731/0xe2c2ff68a6e853b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd69d expref: 8 pid: 6619 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787694.305012:0:9394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41d9dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9394:1872533770033920:192.168.203.53@tcp:104: 00000100:00100000:0.0:1785787694.305091:0:9394:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190770ab6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785787694.310141:0:9394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41d9dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9394:1872533770033920:192.168.203.53@tcp:104: 00010000:00010000:2.0:1785787694.310169:0:9394:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000250f5a6e/0xe2c2ff68a6e853d5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787694.310242:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787694.314089:0:11051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744878464 00000100:00100000:1.0:1785787694.314103:0:11051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744878464 00010000:00010000:1.0:1785787694.314379:0:11051:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006e2a4731/0xe2c2ff68a6e853b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd69d expref: 9 pid: 6619 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787694.314547:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 84 00000100:00100000:0.0:1785787694.314561:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41d9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79280304-55c6-4698-bfc3-29d14648ba45+9:2390:x1872533744878464:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785787694.314576:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785787694.314598:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006e2a4731/0xe2c2ff68a6e853b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd69d expref: 9 pid: 6619 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.314631:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006e2a4731/0xe2c2ff68a6e853b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd69d expref: 9 pid: 6619 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.314653:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e2a4731/0xe2c2ff68a6e853b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd69d expref: 9 pid: 6619 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.314672:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1785787694.314676:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1785787694.314681:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000250f5a6e/0xe2c2ff68a6e853d5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.314691:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000250f5a6e/0xe2c2ff68a6e853d5 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.314725:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785787694.314783:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41d9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79280304-55c6-4698-bfc3-29d14648ba45+8:2390:x1872533744878464:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 226us (4542us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787694.314791:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 84 00010000:00010000:2.0:1785787694.315387:0:9394:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000250f5a6e/0xe2c2ff68a6e853d5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.315407:0:9394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000250f5a6e/0xe2c2ff68a6e853d5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.315438:0:9394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000250f5a6e/0xe2c2ff68a6e853d5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.315446:0:9394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000250f5a6e/0xe2c2ff68a6e853d5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.315453:0:9394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000250f5a6e/0xe2c2ff68a6e853d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.315460:0:9394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919052f5ea00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785787694.315463:0:9394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000250f5a6e/0xe2c2ff68a6e853d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.315472:0:9394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000250f5a6e/0xe2c2ff68a6e853d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.315483:0:9394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000250f5a6e/0xe2c2ff68a6e853d5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.315490:0:9394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000250f5a6e/0xe2c2ff68a6e853d5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787694.315539:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:79280304-55c6-4698-bfc3-29d14648ba45+7:2390:x1872533744878336:12345-192.168.203.53@tcp:1:lhsmtool_posix.0 Request processed in 10716us (10888us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787694.315546:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 70 00000100:00100000:0.0:1785787694.335580:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787694.336222:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744878720 00000100:00100000:1.0:1785787694.336232:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744878720 00000100:00100000:1.0:1785787694.336299:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 230 00000100:00100000:1.0:1785787694.336310:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+19:11651:x1872533744878720:12345-192.168.203.53@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1785787694.336407:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a000/0xe2c2ff68a6e853dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787694.336917:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a000/0xe2c2ff68a6e853dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787694.336947:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a000/0xe2c2ff68a6e853dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.337504:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e853e3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.337518:0:9295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e800/0xe2c2ff68a6e85396 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd688 expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.337527:0:9295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e853e3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.337560:0:9295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e800/0xe2c2ff68a6e85396 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd688 expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.337573:0:9295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e800/0xe2c2ff68a6e85396 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd688 expref: 20 pid: 5822 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787694.337586:0:9295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190771edf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9295:1872533770034048:192.168.203.53@tcp:104: 00000100:00100000:2.0:1785787694.337671:0:9295:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190507ead80 going to sleep for 11 seconds 00000100:00100000:2.0:1785787694.342767:0:9295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190771edf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9295:1872533770034048:192.168.203.53@tcp:104: 00010000:00010000:2.0:1785787694.342793:0:9295:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e853e3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787694.343209:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787694.344750:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744878848 00000100:00100000:1.0:1785787694.344759:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744878848 00010000:00010000:1.0:1785787694.344796:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e800/0xe2c2ff68a6e85396 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd688 expref: 21 pid: 5822 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787694.344865:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 85 00000100:00100000:1.0:1785787694.344874:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79280304-55c6-4698-bfc3-29d14648ba45+21:2390:x1872533744878848:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785787694.344886:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785787694.344893:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e800/0xe2c2ff68a6e85396 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd688 expref: 21 pid: 5822 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787694.344906:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e800/0xe2c2ff68a6e85396 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd688 expref: 21 pid: 5822 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787694.344928:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e800/0xe2c2ff68a6e85396 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd688 expref: 21 pid: 5822 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787694.344944:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff919059e3e200) 00010000:00010000:1.0:1785787694.344949:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e853e3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787694.344958:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e853e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787694.344965:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e853e3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787694.345007:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785787694.345061:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79280304-55c6-4698-bfc3-29d14648ba45+20:2390:x1872533744878848:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 187us (1852us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787694.345069:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 85 00010000:00010000:3.0:1785787694.345236:0:9295:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e853e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787694.345245:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e853e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785787694.345516:0:9295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1785787694.345639:0:9295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1785787694.345691:0:9295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1785787694.345757:0:9295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd92300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9295:1872533770034176:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1785787694.345799:0:9295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787694.345853:0:9295:0:(client.c:2702:ptlrpc_set_wait()) set ffff91906ef69780 going to sleep for 11 seconds 00000100:00100000:1.0:1785787694.348170:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770034176 00000100:00100000:1.0:1785787694.348179:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770034176 00000100:00100000:1.0:1785787694.348227:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1785787694.348235:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9295:x1872533770034176:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1785787694.348330:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9295:x1872533770034176:12345-0@lo:1000:mdt00_003.0 Request processed in 96us (2531us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787694.348346:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1785787694.348375:0:9295:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:3.0:1785787694.348382:0:9295:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:3.0:1785787694.348410:0:9295:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91907732d180, transno 4294967321 00000100:00100000:3.0:1785787694.348433:0:9295:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff91907732d880 x1872533770033280/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1785787710 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787694.348445:0:9295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd92300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9295:1872533770034176:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1785787694.348916:0:9295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1785787694.348974:0:9295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd92300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9295:1872533770034304:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1785787694.349006:0:9295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787694.349027:0:9295:0:(client.c:2702:ptlrpc_set_wait()) set ffff91906ef690c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785787694.349473:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770034304 00000100:00100000:0.0:1785787694.349479:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770034304 00000100:00100000:0.0:1785787694.349505:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1785787694.349512:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9295:x1872533770034304:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1785787694.359438:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:9295:x1872533770034304:12345-0@lo:1000:mdt00_003.0 Request processed in 9916us (10422us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1785787694.359473:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1785787694.359601:0:9295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd92300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9295:1872533770034304:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1785787694.359648:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e853e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787694.359658:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e853e3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787694.359675:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e853e3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787694.359681:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677da00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787694.359686:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e853e3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787694.359693:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e853e3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787694.359707:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff919059e3e200) 00010000:00010000:3.0:1785787694.359710:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785787694.359714:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e853e3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787694.359720:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e853e3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787694.359749:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e85326 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787694.359755:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e85326 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787694.359760:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e85326 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787694.359773:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903a00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787694.359776:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e85326 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787694.359782:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e85326 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787694.359790:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91905685ff00) 00010000:00010000:3.0:1785787694.359792:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785787694.359799:0:9295:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e8532d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd66c expref: 23 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787694.359809:0:9295:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e8532d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd66c expref: 23 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787694.359818:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e8532d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd66c expref: 23 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787694.359869:0:9295:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e8532d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd66c expref: 23 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787694.359883:0:9295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076ecc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9295:1872533770034432:192.168.203.53@tcp:105: 00000100:00100000:3.0:1785787694.359962:0:9295:0:(client.c:2702:ptlrpc_set_wait()) set ffff91906ef690c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785787694.363192:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787694.363278:0:9295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076ecc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9295:1872533770034432:192.168.203.53@tcp:105: 00010000:00010000:2.0:1785787694.363313:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e85326 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.363323:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903a00/0xe2c2ff68a6e85326 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.363353:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e853ea lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.363377:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e853ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.363387:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e853ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.363405:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e853ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.363411:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e853ea lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.363417:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e853ea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.363422:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677d800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787694.363426:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e853ea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.363433:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e853ea lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.363442:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91905685ff00) 00010000:00010000:2.0:1785787694.363445:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787694.363448:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e853ea lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.363454:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e853ea lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.363465:0:9295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a000/0xe2c2ff68a6e853dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.363477:0:9295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a000/0xe2c2ff68a6e853dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.363483:0:9295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a000/0xe2c2ff68a6e853dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.363487:0:9295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91908206a000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787694.363490:0:9295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a000/0xe2c2ff68a6e853dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.363495:0:9295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a000/0xe2c2ff68a6e853dc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.363503:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91905685ff00) 00010000:00010000:2.0:1785787694.363505:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1785787694.363508:0:9295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a000/0xe2c2ff68a6e853dc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.363512:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a000/0xe2c2ff68a6e853dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787694.363722:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+23:11651:x1872533744878720:12345-192.168.203.53@tcp:57:lhsmtool_posix.0 Request processed in 27413us (28150us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1785787694.363733:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 230 00000020:00080000:2.0:1785787694.363738:0:9295:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1785787694.364375:0:11564:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1785787694.364380:0:11564:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1785787694.364559:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744878976 00000100:00100000:1.0:1785787694.364566:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744878976 00000100:00100000:1.0:1785787694.364605:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 61 00000100:00100000:1.0:1785787694.364614:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077088a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+23:11649:x1872533744878976:12345-192.168.203.53@tcp:49:lfs.0 00000100:00100000:1.0:1785787694.364715:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077088a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+23:11649:x1872533744878976:12345-192.168.203.53@tcp:49:lfs.0 Request processed in 100us (1530us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787694.364722:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 61 00000040:00080000:0.0:1785787694.365004:0:11564:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1785787694.365011:0:11564:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1785787694.367428:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787694.367502:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744879232 00000100:00100000:2.0:1785787694.367511:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744879232 00000100:00100000:2.0:1785787694.367562:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 62 00000100:00100000:2.0:1785787694.367571:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190451bc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+23:11651:x1872533744879232:12345-192.168.203.53@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1785787694.368341:0:5823:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1785787694.368454:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1785787694.368493:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e853f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.368509:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e853f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.368521:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e853f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.368529:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e853f1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.368535:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e853f1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.368540:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e853f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787694.369128:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1785787694.369212:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190451bc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+25:11651:x1872533744879232:12345-192.168.203.53@tcp:35:lhsmtool_posix.0 Request processed in 1639us (1788us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1785787694.369220:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 62 00000020:00080000:2.0:1785787694.369225:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1785787694.378353:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785787694.378366:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e853f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787694.378399:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677c800 already unused, calling callback (ffffffffc174c300) 00010000:00010000:3.0:1785787694.378403:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e853f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787694.378413:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e853f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787694.378432:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9190481f9900) 00010000:00010000:3.0:1785787694.378435:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1785787694.378439:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e853f1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787694.378446:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e853f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787694.378467:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787694.378469:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787694.378471:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787694.385469:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787694.388943:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744879488 00000100:00100000:0.0:1785787694.388955:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744879488 00000100:00100000:0.0:1785787694.389056:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 231 00000100:00100000:0.0:1785787694.389067:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077088a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+25:11649:x1872533744879488:12345-192.168.203.53@tcp:58:lfs.0 00000040:00080000:0.0:1785787694.390948:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1785787694.391118:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077088a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+25:11649:x1872533744879488:12345-192.168.203.53@tcp:58:lfs.0 Request processed in 2050us (5654us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787694.391127:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 231 00000100:00100000:2.0:1785787694.445018:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787694.445178:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744879616 00000100:00100000:0.0:1785787694.445187:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744879616 00000100:00100000:0.0:1785787694.445242:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 232 00000100:00100000:0.0:1785787694.445251:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190771edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+25:11653:x1872533744879616:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:0.0:1785787694.445273:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787694.445305:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e200/0xe2c2ff68a6e853f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd6a4 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.445364:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e800/0xe2c2ff68a6e853ff lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.445377:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e800/0xe2c2ff68a6e853ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.445399:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e800/0xe2c2ff68a6e853ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.445428:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e000/0xe2c2ff68a6e85406 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.445436:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e000/0xe2c2ff68a6e85406 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.445443:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e000/0xe2c2ff68a6e85406 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.445704:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f600/0xe2c2ff68a6e8540d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.445715:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e85318 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd665 expref: 26 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.445724:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f600/0xe2c2ff68a6e8540d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.445766:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e85318 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd665 expref: 26 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.445780:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e85318 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd665 expref: 26 pid: 9295 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787694.445793:0:5821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b6c9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5821:1872533770034560:192.168.203.53@tcp:104: 00000100:00100000:3.0:1785787694.457541:0:5821:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190770abf00 going to sleep for 11 seconds 00000100:00100000:3.0:1785787694.463159:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787694.463359:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744879872 00000100:00100000:2.0:1785787694.463375:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744879872 00000100:00100000:2.0:1785787694.463502:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 63 00000100:00100000:2.0:1785787694.463513:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+27:9981:x1872533744879872:12345-192.168.203.53@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1785787694.463534:0:5821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b6c9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5821:1872533770034560:192.168.203.53@tcp:104: 00010000:00010000:0.0:1785787694.463558:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f600/0xe2c2ff68a6e8540d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787694.463745:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+28:9981:x1872533744879872:12345-192.168.203.53@tcp:35:ldlm_bl.0 Request processed in 233us (594us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1785787694.463761:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 63 00000100:00100000:3.0:1785787694.468948:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787694.481724:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744880000 00000100:00100000:1.0:1785787694.481738:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744880000 00010000:00010000:1.0:1785787694.481784:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e85318 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd665 expref: 28 pid: 9295 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787694.481819:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 86 00000100:00100000:1.0:1785787694.481845:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051464c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79280304-55c6-4698-bfc3-29d14648ba45+28:2391:x1872533744880000:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785787694.481874:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785787694.481882:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e85318 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd665 expref: 28 pid: 9295 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787694.481896:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e85318 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd665 expref: 28 pid: 9295 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787694.481916:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903800/0xe2c2ff68a6e85318 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd665 expref: 28 pid: 9295 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787694.481932:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91905685ff00) 00010000:00010000:1.0:1785787694.481937:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f600/0xe2c2ff68a6e8540d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787694.481946:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f600/0xe2c2ff68a6e8540d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787694.481953:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f600/0xe2c2ff68a6e8540d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787694.481984:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785787694.482046:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051464c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79280304-55c6-4698-bfc3-29d14648ba45+27:2391:x1872533744880000:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 218us (13106us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787694.482054:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 86 00010000:00010000:0.0:1785787694.482342:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f600/0xe2c2ff68a6e8540d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.482351:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f600/0xe2c2ff68a6e8540d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785787694.482441:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1785787694.482445:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1785787694.482462:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f600/0xe2c2ff68a6e8540d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.482474:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f600/0xe2c2ff68a6e8540d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.482483:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e800/0xe2c2ff68a6e853ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.482490:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e800/0xe2c2ff68a6e853ff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.482497:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e800/0xe2c2ff68a6e853ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.482503:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919052f5e800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1785787694.482506:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e800/0xe2c2ff68a6e853ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.482514:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e800/0xe2c2ff68a6e853ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.482523:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff919059e3e900) 00010000:00010000:0.0:1785787694.482532:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785787694.482536:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e800/0xe2c2ff68a6e853ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.482543:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e800/0xe2c2ff68a6e853ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.483222:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e000/0xe2c2ff68a6e85406 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.483230:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e000/0xe2c2ff68a6e85406 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.483237:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e000/0xe2c2ff68a6e85406 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.483242:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919052f5e000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1785787694.483246:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e000/0xe2c2ff68a6e85406 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.483252:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e000/0xe2c2ff68a6e85406 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.483261:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff919059e3e000) 00010000:00010000:0.0:1785787694.483264:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785787694.483266:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e000/0xe2c2ff68a6e85406 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.483272:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e000/0xe2c2ff68a6e85406 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.483692:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e200/0xe2c2ff68a6e853f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd6a4 expref: 27 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.483721:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f600/0xe2c2ff68a6e8540d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd6a4 expref: 26 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787694.483728:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91905685ff00) 00010000:00010000:0.0:1785787694.483730:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785787694.483733:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919052f5f600, rc 0) 00000100:00100000:0.0:1785787694.484217:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190771edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+26:11653:x1872533744879616:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 38966us (39205us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787694.484225:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 232 00010000:00010000:2.0:1785787694.578977:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1785787695.418563:0:11564:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1785787695.418570:0:11564:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1785787695.418623:0:11564:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1785787695.418628:0:11564:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1785787695.419964:0:11564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190771ec700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11564:1872533770034688:192.168.203.53@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1785787695.420052:0:11564:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190515b7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1785787695.423939:0:11564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190771ec700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11564:1872533770034688:192.168.203.53@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1785787695.433447:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787695.433934:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744880128 00000100:00100000:3.0:1785787695.433943:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744880128 00000100:00100000:3.0:1785787695.434015:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 233 00000100:00100000:3.0:1785787695.434026:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b6c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+26:11664:x1872533744880128:12345-192.168.203.53@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1785787695.434062:0:5820:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1785787695.434171:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b6c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+26:11664:x1872533744880128:12345-192.168.203.53@tcp:53:lhsmtool_posix.0 Request processed in 147us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787695.434198:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 233 00000100:00080000:0.0:1785787695.435426:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1785787695.444790:0:12498:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1785787695.444799:0:12498:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1785787695.444882:0:12498:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1785787695.444887:0:12498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1785787695.450874:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787695.450968:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744880384 00000100:00100000:3.0:1785787695.450976:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744880384 00000100:00100000:3.0:1785787695.451039:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 234 00000100:00100000:3.0:1785787695.451047:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+26:11664:x1872533744880384:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785787695.451066:0:9295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787695.451085:0:9295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e85414 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd6ab expref: -99 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787695.451172:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e8541b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787695.451183:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e8541b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787695.451193:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e8541b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785787695.451202:0:9295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1785787695.451304:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e85414 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd6ab expref: 29 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787695.451318:0:9295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e8541b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd6ab expref: 28 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787695.451339:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91905685ff00) 00010000:00010000:3.0:1785787695.451342:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785787695.451344:0:9295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f903200, rc 0) 00000100:00100000:3.0:1785787695.451414:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+28:11664:x1872533744880384:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 366us (546us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1785787695.451420:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 234 00000100:00100000:1.0:1785787695.455878:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787695.455905:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787695.455926:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744880640 00000100:00100000:1.0:1785787695.455933:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744880640 00000100:00100000:1.0:1785787695.455992:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 235 00000100:00100000:1.0:1785787695.455999:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+28:11664:x1872533744880640:12345-192.168.203.53@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1785787695.456064:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e85429 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787695.456079:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e85429 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787695.456090:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e85429 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787695.456259:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e85429 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787695.456267:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e85429 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787695.456274:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e85429 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787695.456280:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91908206a400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787695.456284:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e85429 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787695.456291:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e85429 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787695.456304:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91905685ff00) 00010000:00010000:1.0:1785787695.456307:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1785787695.456311:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e85429 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787695.456329:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91908206a400/0xe2c2ff68a6e85429 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787695.456470:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+29:11664:x1872533744880640:12345-192.168.203.53@tcp:57:lhsmtool_posix.0 Request processed in 471us (600us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1785787695.456478:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 235 00000100:00100000:1.0:1785787695.456500:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744880768 00000100:00100000:1.0:1785787695.456502:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744880768 00000100:00100000:1.0:1785787695.456542:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 18 00000100:00100000:1.0:1785787695.456548:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79280304-55c6-4698-bfc3-29d14648ba45+29:2389:x1872533744880768:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785787695.456557:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785787695.456569:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903200/0xe2c2ff68a6e8541b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd6ab expref: 29 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787695.456578:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91905685ff00) 00010000:00010000:1.0:1785787695.456581:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785787695.456599:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79280304-55c6-4698-bfc3-29d14648ba45+28:2389:x1872533744880768:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 51us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787695.456605:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 18 00000040:00080000:1.0:1785787695.456847:0:11564:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1785787695.456852:0:11564:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1785787695.457320:0:11564:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1785787695.457327:0:11564:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1785787695.480455:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787695.482492:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744881024 00000100:00100000:2.0:1785787695.482503:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744881024 00000100:00100000:2.0:1785787695.482566:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 64 00000100:00100000:2.0:1785787695.482575:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+28:11664:x1872533744881024:12345-192.168.203.53@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1785787695.482795:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+29:11664:x1872533744881024:12345-192.168.203.53@tcp:35:lhsmtool_posix.0 Request processed in 221us (2347us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1785787695.482803:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 64 00010000:00010000:1.0:1785787695.604054:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787695.744086:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787695.744227:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744881152 00000100:00100000:2.0:1785787695.744237:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744881152 00000100:00100000:2.0:1785787695.744286:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 313 00000100:00100000:2.0:1785787695.744294:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2391:x1872533744881152:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:2.0:1785787695.744453:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2391:x1872533744881152:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 159us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787695.744461:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 313 00000100:00100000:2.0:1785787695.756077:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787695.756112:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787695.756135:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787695.756248:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744881280 00000100:00100000:1.0:1785787695.756258:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744881280 00000100:00100000:1.0:1785787695.756329:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744881408 00000100:00100000:1.0:1785787695.756343:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744881408 00000100:00100000:1.0:1785787695.756397:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 111 00000100:00100000:1.0:1785787695.756406:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190771ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+5:2391:x1872533744881280:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1785787695.756464:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190771ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+5:2391:x1872533744881280:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 59us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787695.756471:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 111 00000100:00100000:1.0:1785787695.756485:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 112 00000100:00100000:1.0:1785787695.756490:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190771ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+7:2390:x1872533744881408:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1785787695.756509:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190771ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+7:2390:x1872533744881408:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 19us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787695.756514:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 112 00000100:00080000:2.0:1785787695.756795:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785787695.756799:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785787695.756841:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744881536 00000100:00100000:3.0:1785787695.756846:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744881536 00000100:00100000:3.0:1785787695.756888:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 189 00000100:00100000:3.0:1785787695.756894:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190771ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4ec65b7-e63e-42dc-becf-cba362002085+5:2390:x1872533744881536:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1785787695.756929:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190771ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4ec65b7-e63e-42dc-becf-cba362002085+5:2390:x1872533744881536:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 36us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787695.756935:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 189 00000100:00080000:2.0:1785787695.757028:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785787696.051539:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190771ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533770035072:0@lo:400:kworker.0 00000100:00100000:1.0:1785787696.051602:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787696.051726:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190771edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533770034944:0@lo:400:kworker.0 00000100:00100000:3.0:1785787696.051770:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787696.051794:0:3334:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785787696.051799:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190771ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533770034816:0@lo:400:kworker.0 00000100:00100000:3.0:1785787696.051822:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787696.051875:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770034816 00000100:00100000:3.0:1785787696.051881:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770034816 00000100:00100000:3.0:1785787696.051921:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1785787696.051928:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+19:3334:x1872533770034816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787696.051973:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+19:3334:x1872533770034816:12345-0@lo:400:kworker.0 Request processed in 45us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787696.051985:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1785787696.052031:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190771ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533770034816:0@lo:400:kworker.0 00000100:00100000:3.0:1785787696.052065:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190771eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770035200:0@lo:400:kworker.0 00000100:00100000:3.0:1785787696.052090:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787696.052119:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770035200 00000100:00100000:3.0:1785787696.052122:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770035200 00000100:00100000:3.0:1785787696.052151:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1785787696.052156:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3336:x1872533770035200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787696.052199:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3336:x1872533770035200:12345-0@lo:400:kworker.0 Request processed in 43us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787696.052205:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:3.0:1785787696.052218:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785787696.052231:0:3336:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:3.0:1785787696.052236:0:3336:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:3.0:1785787696.052253:0:3336:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff91907732f800 x1872533770033536/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1785787710 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787696.052263:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190771eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770035200:0@lo:400:kworker.0 00000100:00100000:0.0:1785787696.053389:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770035072 00000100:00100000:0.0:1785787696.053396:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770035072 00000100:00100000:0.0:1785787696.053439:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770034944 00000100:00100000:0.0:1785787696.053442:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770034944 00000100:00100000:0.0:1785787696.053472:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1785787696.053479:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533770035072:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1785787696.053644:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785787696.053662:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1785787696.053671:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533770034944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787696.053706:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533770034944:12345-0@lo:400:kworker.0 Request processed in 37us (1935us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787696.053712:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1785787696.053739:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190771edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533770034944:0@lo:400:kworker.0 00000100:00100000:3.0:1785787696.058808:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190771ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3333:1872533770035328:0@lo:400:kworker.0 00000100:00100000:3.0:1785787696.058928:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787696.058968:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785787696.058976:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190771efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770035456:0@lo:400:kworker.0 00000100:00100000:3.0:1785787696.059006:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787696.059048:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770035456 00000100:00100000:3.0:1785787696.059058:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770035456 00000100:00100000:3.0:1785787696.059116:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1785787696.059125:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3333:x1872533770035456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787696.059185:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3333:x1872533770035456:12345-0@lo:400:kworker.0 Request processed in 61us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787696.059192:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:3.0:1785787696.059215:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785787696.059248:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190771efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770035456:0@lo:400:kworker.0 00000100:00100000:2.0:1785787696.059385:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770035328 00000100:00100000:2.0:1785787696.059390:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770035328 00000100:00100000:2.0:1785787696.059429:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1785787696.059436:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1872533770035328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787696.059473:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1872533770035328:12345-0@lo:400:kworker.0 Request processed in 37us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787696.059480:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00080000:3.0:1785787696.059587:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785787696.059606:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190771ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3333:1872533770035328:0@lo:400:kworker.0 00000100:00100000:0.0:1785787696.063692:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533770035072:12345-0@lo:400:kworker.0 Request processed in 10206us (12082us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787696.063705:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1785787696.063912:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190771ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533770035072:0@lo:400:kworker.0 00000100:00100000:1.0:1785787696.566639:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b6cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770035584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785787696.566710:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787696.566860:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770035584 00000100:00100000:2.0:1785787696.566868:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770035584 00000100:00100000:2.0:1785787696.566927:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1785787696.566935:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3335:x1872533770035584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785787696.566966:0:6620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785787696.567006:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3335:x1872533770035584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787696.567012:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1785787696.567050:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b6cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770035584:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785787696.631500:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1785787697.413934:0:12549:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1785787697.413943:0:12549:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1785787697.413990:0:12549:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1785787697.413995:0:12549:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1785787697.602430:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787697.605734:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744881792 00000100:00100000:2.0:1785787697.605745:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744881792 00000100:00100000:2.0:1785787697.605861:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 236 00000100:00100000:2.0:1785787697.605874:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b6c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+29:11685:x1872533744881792:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:2.0:1785787697.605898:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787697.605926:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85430 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd6b2 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787697.606015:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e85437 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787697.606029:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e85437 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787697.606041:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e85437 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787697.606051:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1785787697.606160:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85430 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd6b2 expref: 32 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787697.606175:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e85437 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd6b2 expref: 31 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787697.606184:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91905685ff00) 00010000:00010000:2.0:1785787697.606186:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1785787697.606189:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677d800, rc 0) 00000100:00100000:2.0:1785787697.606251:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b6c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+31:11685:x1872533744881792:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 381us (3830us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1785787697.606266:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 236 00000100:00080000:0.0:1785787697.611137:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785787697.614915:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787697.617352:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744881920 00000100:00100000:2.0:1785787697.617364:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744881920 00000100:00100000:2.0:1785787697.618355:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 237 00000100:00100000:2.0:1785787697.618376:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b6cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+31:11685:x1872533744881920:12345-192.168.203.53@tcp:54:lfs.0 00010000:00010000:2.0:1785787697.618449:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85445 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787697.618465:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85445 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787697.618476:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85445 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787697.618503:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85445 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787697.618509:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85445 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787697.618516:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85445 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787697.618522:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677ce00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787697.618527:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85445 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787697.618533:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85445 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787697.618544:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91905685ff00) 00010000:00010000:2.0:1785787697.618547:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785787697.618551:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85445 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787697.618558:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85445 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787697.618635:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b6cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+31:11685:x1872533744881920:12345-192.168.203.53@tcp:54:lfs.0 Request processed in 270us (3727us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787697.618642:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 237 00010000:00010000:2.0:1785787697.655377:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785787697.701606:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787697.701671:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744882048 00000100:00100000:3.0:1785787697.701681:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744882048 00000100:00100000:3.0:1785787697.701752:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 71 00000100:00100000:3.0:1785787697.701763:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+7:2389:x1872533744882048:12345-192.168.203.53@tcp:101:cat.0 00010000:00010000:3.0:1785787697.701780:0:6618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787697.701798:0:6618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051f52044/0xe2c2ff68a6e8544c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd6b9 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785787697.701821:0:6618:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a70f52d, atime: 0x6a70f52c, ctime: 0x6a70f52d, blocks: 0xb 00010000:00010000:3.0:1785787697.701882:0:6618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1785787697.701886:0:6618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785787697.701895:0:6618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051f52044/0xe2c2ff68a6e8544c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd6b9 expref: 8 pid: 6618 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787697.701914:0:6618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000051f52044/0xe2c2ff68a6e8544c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd6b9 expref: 8 pid: 6618 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787697.701927:0:6618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f903000, rc 0) 00000100:00080000:0.0:1785787697.702002:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785787697.702245:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+8:2389:x1872533744882048:12345-192.168.203.53@tcp:101:cat.0 Request processed in 482us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787697.702252:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 71 00000100:00100000:2.0:1785787697.708978:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787697.709127:0:6623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744882176 00000100:00100000:3.0:1785787697.709137:0:6623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744882176 00002000:00100000:3.0:1785787697.709181:0:6623:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9190771eea00 x1872533744882176/t0(0) o3->79280304-55c6-4698-bfc3-29d14648ba45@192.168.203.53@tcp:553/0 lens 488/0 e 0 to 0 dl 1785787708 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785787697.709192:0:6623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9190771eea00 with x1872533744882176 ext(0->4095) 00002000:00010000:3.0:1785787697.709199:0:6623:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9190771eea00 00000100:00100000:3.0:1785787697.709230:0:6623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 7 00000100:00100000:3.0:1785787697.709249:0:6623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190771eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:79280304-55c6-4698-bfc3-29d14648ba45+8:2391:x1872533744882176:12345-192.168.203.53@tcp:3:cat.0 00000100:00100000:3.0:1785787697.709459:0:6623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190771eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:79280304-55c6-4698-bfc3-29d14648ba45+8:2391:x1872533744882176:12345-192.168.203.53@tcp:3:cat.0 Request processed in 211us (489us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1785787697.709466:0:6623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 7 00002000:00100000:3.0:1785787697.709473:0:6623:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9190771eea00 x1872533744882176/t0(0) o3->79280304-55c6-4698-bfc3-29d14648ba45@192.168.203.53@tcp:553/0 lens 488/4536 e 0 to 0 dl 1785787708 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785787697.709480:0:6623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9190771eea00 with x1872533744882176 ext(0->4095) 00002000:00010000:3.0:1785787697.709484:0:6623:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9190771eea00 00000100:00100000:2.0:1785787698.611468:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785787698.611489:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076eeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770035712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785787698.611554:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787698.611640:0:8140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770035712 00000100:00100000:0.0:1785787698.611648:0:8140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770035712 00000100:00100000:0.0:1785787698.611714:0:8140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1785787698.611724:0:8140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190771ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3335:x1872533770035712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785787698.611757:0:8140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785787698.611807:0:8140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190771ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3335:x1872533770035712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787698.611814:0:8140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1785787698.611870:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076eeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770035712:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1785787698.611883:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1785787698.675536:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1785787699.206802:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000001:00080000:3.0:1785787699.206824:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000001:00080000:3.0:1785787699.206845:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1785787699.206871:0:5843:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91906ef69780 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1785787699.206876:0:5843:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff91904824c500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91906ef69e40 00000020:00080000:3.0:1785787699.206880:0:5843:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff91904824c900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff918f42397000 00000020:00080000:3.0:1785787699.206905:0:5843:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1785787699.206924:0:5854:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1785787699.207129:0:5854:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:0.0:1785787699.269294:0:6642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00010000:00010000:1.0:1785787699.700684:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1785787699.716011:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:3.0:1785787699.716026:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000040:00080000:1.0:1785787700.596009:0:11564:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1785787700.596018:0:11564:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1785787700.596320:0:11564:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1785787700.596327:0:11564:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1785787700.722935:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787700.871889:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787700.871923:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787700.871936:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744882304 00000100:00100000:3.0:1785787700.871946:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744882304 00000100:00100000:0.0:1785787700.871947:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787700.871964:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787700.871983:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787700.871991:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 315 00000100:00100000:3.0:1785787700.872000:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2388:x1872533744882304:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1785787700.872001:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744882432 00000100:00100000:0.0:1785787700.872004:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744882432 00000100:00100000:0.0:1785787700.872037:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744882816 00000100:00100000:0.0:1785787700.872039:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744882816 00000100:00100000:0.0:1785787700.872057:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 193 00000100:00100000:3.0:1785787700.872063:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2388:x1872533744882304:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 64us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787700.872063:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b6cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+18:2388:x1872533744882432:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1785787700.872069:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 315 00000100:00100000:0.0:1785787700.872095:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b6cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+18:2388:x1872533744882432:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 32us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787700.872102:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 193 00000100:00100000:0.0:1785787700.872115:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 194 00000100:00100000:0.0:1785787700.872120:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b6caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4ec65b7-e63e-42dc-becf-cba362002085+5:2388:x1872533744882816:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1785787700.872156:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b6caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4ec65b7-e63e-42dc-becf-cba362002085+5:2388:x1872533744882816:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 35us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787700.872163:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 194 00000100:00100000:0.0:1785787700.872179:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744882560 00000100:00100000:0.0:1785787700.872183:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744882560 00000100:00100000:0.0:1785787700.872215:0:6617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744882688 00000100:00100000:0.0:1785787700.872218:0:6617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744882688 00000100:00100000:0.0:1785787700.872245:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 115 00000100:00100000:0.0:1785787700.872251:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b6c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:79280304-55c6-4698-bfc3-29d14648ba45+5:2388:x1872533744882560:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1785787700.872283:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b6c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:79280304-55c6-4698-bfc3-29d14648ba45+5:2388:x1872533744882560:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 32us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787700.872290:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 115 00000100:00100000:0.0:1785787700.872301:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 116 00000100:00100000:0.0:1785787700.872306:0:6617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b6cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:79280304-55c6-4698-bfc3-29d14648ba45+7:2388:x1872533744882688:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1785787700.872353:0:6617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b6cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:79280304-55c6-4698-bfc3-29d14648ba45+7:2388:x1872533744882688:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 37us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787700.872359:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 116 00000100:00080000:0.0:1785787700.872443:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785787700.872446:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785787700.872449:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785787701.171538:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190771ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533770035968:0@lo:400:kworker.0 00000100:00100000:0.0:1785787701.171604:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190771eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533770035840:0@lo:400:kworker.0 00000100:00100000:1.0:1785787701.175167:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190771ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770036224:0@lo:400:kworker.0 00000100:00100000:0.0:1785787701.182480:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787701.182548:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190771ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3333:1872533770036352:0@lo:400:kworker.0 00000100:00100000:0.0:1785787701.182579:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787701.182628:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770035840 00000100:00100000:0.0:1785787701.182647:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770035840 00000100:00100000:0.0:1785787701.182687:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1785787701.182696:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+19:3333:x1872533770035840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787701.182745:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+19:3333:x1872533770035840:12345-0@lo:400:kworker.0 Request processed in 49us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787701.182752:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1785787701.182799:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190771eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533770035840:0@lo:400:kworker.0 00000100:00100000:0.0:1785787701.182853:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190771ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533770036096:0@lo:400:kworker.0 00000100:00100000:0.0:1785787701.182878:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787701.182905:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770036352 00000100:00100000:0.0:1785787701.182909:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770036352 00000100:00100000:0.0:1785787701.182937:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770036096 00000100:00100000:0.0:1785787701.182940:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770036096 00000100:00100000:0.0:1785787701.182958:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1785787701.182964:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b6c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1872533770036352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787701.182997:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b6c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1872533770036352:12345-0@lo:400:kworker.0 Request processed in 33us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787701.183003:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1785787701.183014:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1785787701.183020:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b6c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533770036096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787701.183049:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b6c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533770036096:12345-0@lo:400:kworker.0 Request processed in 30us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787701.183056:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00080000:0.0:1785787701.183070:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785787701.183094:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190771ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533770036096:0@lo:400:kworker.0 00000100:00100000:0.0:1785787701.183115:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190771ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3333:1872533770036352:0@lo:400:kworker.0 00000100:00100000:3.0:1785787701.187243:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787701.187288:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9190771ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770036480:0@lo:400:kworker.0 00000100:00100000:3.0:1785787701.187317:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787701.187516:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770035968 00000100:00100000:2.0:1785787701.187524:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770035968 00000100:00100000:2.0:1785787701.187587:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1785787701.187596:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533770035968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787701.187644:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533770035968:12345-0@lo:400:kworker.0 Request processed in 50us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787701.187651:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1785787701.187673:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770036480 00000100:00100000:2.0:1785787701.187676:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770036480 00000100:00100000:2.0:1785787701.187721:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1785787701.187727:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770036480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787701.187757:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770036480:12345-0@lo:400:kworker.0 Request processed in 31us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787701.187763:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:2.0:1785787701.187777:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785787701.188051:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787701.188102:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770036224 00000100:00100000:1.0:1785787701.188106:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770036224 00000100:00100000:1.0:1785787701.188133:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1785787701.188139:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770036224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787701.188170:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770036224:12345-0@lo:400:kworker.0 Request processed in 32us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787701.188176:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1785787701.188215:0:3336:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1785787701.188221:0:3336:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91907732f800, transno 4294967310 00000100:00100000:1.0:1785787701.188231:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190771ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770036224:0@lo:400:kworker.0 00000100:00100000:3.0:1785787701.188539:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190771ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533770035968:0@lo:400:kworker.0 00000100:00100000:3.0:1785787701.188549:0:3334:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1785787701.188561:0:3334:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91907732d880, transno 4294967322 00000004:00080000:3.0:1785787701.188569:0:3334:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1785787701.188585:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9190771ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770036480:0@lo:400:kworker.0 00000100:00080000:2.0:1785787701.188679:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785787701.683239:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785787701.683266:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b6c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770036608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785787701.683347:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787701.683493:0:6621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770036608 00000100:00100000:0.0:1785787701.683500:0:6621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770036608 00000100:00100000:0.0:1785787701.683545:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1785787701.683554:0:6621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770036608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785787701.683585:0:6621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785787701.683627:0:6621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770036608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787701.683634:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1785787701.683776:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b6c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770036608:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785787701.747692:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787702.771019:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787703.667912:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787703.672648:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744882944 00000100:00100000:2.0:1785787703.672662:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744882944 00000100:00100000:3.0:1785787703.673215:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 238 00000100:00100000:3.0:1785787703.673233:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b6ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+18:11330:x1872533744882944:12345-192.168.203.53@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1785787703.673366:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b6ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79280304-55c6-4698-bfc3-29d14648ba45+18:11330:x1872533744882944:12345-192.168.203.53@tcp:60:lhsmtool_posix.0 Request processed in 137us (5462us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787703.673374:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 238 00000100:00100000:0.0:1785787703.679006:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787703.679215:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744883200 00000100:00100000:3.0:1785787703.679231:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744883200 00000100:00100000:3.0:1785787703.679298:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 65 00000100:00100000:3.0:1785787703.679308:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b6c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+18:11330:x1872533744883200:12345-192.168.203.53@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1785787703.681802:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b6c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+19:11330:x1872533744883200:12345-192.168.203.53@tcp:35:lhsmtool_posix.0 Request processed in 2491us (2797us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1785787703.681813:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 65 00000100:00080000:2.0:1785787703.684853:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785787703.731154:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785787703.731186:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076eee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770036736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785787703.731253:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787703.732448:0:8140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770036736 00000100:00100000:2.0:1785787703.732456:0:8140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770036736 00000100:00100000:2.0:1785787703.732617:0:8140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1785787703.732627:0:8140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b6ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533770036736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785787703.732658:0:8140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785787703.732714:0:8140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b6ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533770036736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (1462us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787703.732721:0:8140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1785787703.732797:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076eee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770036736:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1785787703.733576:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1785787703.795053:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785787704.195945:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787704.196978:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744883328 00000100:00100000:2.0:1785787704.196988:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744883328 00000100:00100000:2.0:1785787704.197055:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 239 00000100:00100000:2.0:1785787704.197064:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4ec65b7-e63e-42dc-becf-cba362002085+5:12136:x1872533744883328:12345-192.168.203.53@tcp:101:lsof.0 00010000:00010000:2.0:1785787704.197084:0:9295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787704.197128:0:9295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d600/0xe2c2ff68a6e85453 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd6c0 expref: -99 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787704.197195:0:9295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e8545a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787704.197226:0:9295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e8545a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787704.197250:0:9295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e8545a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787704.197686:0:9295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1785787704.197690:0:9295:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1785787704.197768:0:9295:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e8545a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787704.197793:0:9295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d600/0xe2c2ff68a6e85453 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd6c0 expref: 7 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787704.197810:0:9295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e8545a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd6c0 expref: 6 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787704.197819:0:9295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9190481f9b00) 00010000:00010000:2.0:1785787704.197822:0:9295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785787704.197865:0:9295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677da00, rc 0) 00000100:00080000:0.0:1785787704.198034:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785787704.198149:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4ec65b7-e63e-42dc-becf-cba362002085+6:12136:x1872533744883328:12345-192.168.203.53@tcp:101:lsof.0 Request processed in 1086us (2210us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787704.198156:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 239 00000020:00080000:2.0:1785787704.360563:0:5843:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:2.0:1785787704.360589:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1785787704.360631:0:5854:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1785787704.360644:0:5854:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1785787704.823405:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787705.843019:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787705.987010:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787705.987052:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787705.987147:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744883456 00000100:00100000:3.0:1785787705.987157:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744883456 00000100:00100000:3.0:1785787705.987235:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 317 00000100:00100000:3.0:1785787705.987246:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2389:x1872533744883456:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1785787705.987321:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2389:x1872533744883456:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 77us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787705.987329:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 317 00000100:00100000:0.0:1785787705.987746:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787705.987769:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787705.987794:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787705.987845:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744883968 00000100:00100000:1.0:1785787705.987849:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744883968 00000100:00100000:1.0:1785787705.987874:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744883584 00000100:00100000:1.0:1785787705.987877:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744883584 00000100:00100000:1.0:1785787705.987907:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 198 00000100:00100000:1.0:1785787705.987916:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b6c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4ec65b7-e63e-42dc-becf-cba362002085+6:2389:x1872533744883968:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1785787705.987965:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b6c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4ec65b7-e63e-42dc-becf-cba362002085+6:2389:x1872533744883968:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 50us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787705.987972:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 198 00000100:00100000:1.0:1785787705.987988:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 199 00000100:00100000:1.0:1785787705.987994:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b6c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+18:2389:x1872533744883584:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1785787705.988021:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b6c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79280304-55c6-4698-bfc3-29d14648ba45+18:2389:x1872533744883584:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 27us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787705.988036:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 199 00000100:00080000:1.0:1785787705.988053:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785787706.000606:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744883712 00000100:00100000:2.0:1785787706.000619:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744883712 00000100:00100000:2.0:1785787706.000694:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744883840 00000100:00100000:2.0:1785787706.000697:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744883840 00000100:00100000:2.0:1785787706.000734:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 119 00000100:00100000:2.0:1785787706.000742:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b6cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+5:2389:x1872533744883712:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:2.0:1785787706.000808:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b6cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+5:2389:x1872533744883712:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 68us (13757us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787706.000815:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 119 00000100:00100000:2.0:1785787706.000845:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 120 00000100:00100000:2.0:1785787706.000851:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b6c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+7:2389:x1872533744883840:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:2.0:1785787706.000872:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b6c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+7:2389:x1872533744883840:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 21us (13077us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787706.000878:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 120 00000100:00080000:1.0:1785787706.002334:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785787706.002339:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785787706.293235:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533770036992:0@lo:400:kworker.0 00000100:00100000:3.0:1785787706.293302:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787706.293358:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076eedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533770037120:0@lo:400:kworker.0 00000100:00100000:3.0:1785787706.293382:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076eee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770037504:0@lo:400:kworker.0 00000100:00100000:2.0:1785787706.293395:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787706.293420:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787706.293436:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785787706.293444:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076eec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770037248:0@lo:400:kworker.0 00000100:00100000:3.0:1785787706.293459:0:3334:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1785787706.293480:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076eee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533770036864:0@lo:400:kworker.0 00000100:00100000:2.0:1785787706.293488:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787706.293518:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787706.293524:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770037504 00000100:00100000:2.0:1785787706.293532:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770037504 00000100:00100000:3.0:1785787706.293545:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3334:1872533770037376:0@lo:400:kworker.0 00000100:00100000:3.0:1785787706.293570:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787706.293596:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770037248 00000100:00100000:2.0:1785787706.293600:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770037248 00000100:00100000:3.0:1785787706.293605:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770036992 00000100:00100000:3.0:1785787706.293611:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770036992 00000100:00100000:2.0:1785787706.293630:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1785787706.293641:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770037504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787706.293656:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770037120 00000100:00100000:3.0:1785787706.293662:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770037120 00000100:00100000:3.0:1785787706.293684:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770037376 00000100:00100000:3.0:1785787706.293687:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770037376 00000100:00100000:2.0:1785787706.293693:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770037504:12345-0@lo:400:kworker.0 Request processed in 55us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787706.293705:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1785787706.293705:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1785787706.293716:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533770036992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787706.293740:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1785787706.293750:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190771edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533770037248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787706.293756:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533770036992:12345-0@lo:400:kworker.0 Request processed in 41us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787706.293765:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1785787706.293784:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1785787706.293791:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190771efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533770037120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787706.293808:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190771edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533770037248:12345-0@lo:400:kworker.0 Request processed in 60us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787706.293816:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1785787706.293848:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190771efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533770037120:12345-0@lo:400:kworker.0 Request processed in 37us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787706.293857:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1785787706.293872:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1785787706.293877:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076eec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770037248:0@lo:400:kworker.0 00000100:00100000:3.0:1785787706.293881:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3334:x1872533770037376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787706.293891:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076eedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533770037120:0@lo:400:kworker.0 00000100:00100000:3.0:1785787706.293940:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3334:x1872533770037376:12345-0@lo:400:kworker.0 Request processed in 61us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787706.293948:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1785787706.294274:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3334:1872533770037376:0@lo:400:kworker.0 00000100:00100000:2.0:1785787706.294284:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533770036992:0@lo:400:kworker.0 00000100:00100000:2.0:1785787706.294301:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076eee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770037504:0@lo:400:kworker.0 00000100:00080000:1.0:1785787706.294332:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1785787706.294339:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785787706.294341:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785787706.295157:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770036864 00000100:00100000:0.0:1785787706.295163:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770036864 00000100:00100000:0.0:1785787706.295202:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1785787706.295209:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+19:3334:x1872533770036864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787706.295259:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+19:3334:x1872533770036864:12345-0@lo:400:kworker.0 Request processed in 51us (1742us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787706.295274:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1785787706.295797:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076eee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533770036864:0@lo:400:kworker.0 00000100:00100000:3.0:1785787706.804852:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785787706.804875:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b6c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770037632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785787706.804937:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787706.805051:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770037632 00000100:00100000:0.0:1785787706.805059:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770037632 00000100:00100000:0.0:1785787706.805100:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1785787706.805108:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770037632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785787706.805139:0:6620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785787706.805186:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770037632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787706.805194:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1785787706.805327:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b6c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770037632:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1785787706.866995:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787707.892340:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1785787708.686009:0:12751:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 16:08:27 (1785787707) 00000100:00100000:2.0:1785787708.851856:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785787708.851876:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770037760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785787708.851937:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787708.852098:0:8140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770037760 00000100:00100000:3.0:1785787708.852106:0:8140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770037760 00000100:00100000:3.0:1785787708.852169:0:8140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1785787708.852179:0:8140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190771eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533770037760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785787708.852210:0:8140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785787708.852251:0:8140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190771eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533770037760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787708.852259:0:8140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1785787708.852315:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fc5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770037760:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1785787708.852408:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1785787708.915020:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787709.941918:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1785787710.835987:0:11564:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1785787710.835995:0:11564:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1785787710.836474:0:11564:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1785787710.836482:0:11564:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1785787710.963366:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787711.108690:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787711.108726:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787711.108751:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744884096 00000100:00100000:3.0:1785787711.108760:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744884096 00000100:00100000:3.0:1785787711.108807:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 319 00000100:00100000:3.0:1785787711.108816:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190514e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2388:x1872533744884096:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1785787711.108896:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190514e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2388:x1872533744884096:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 81us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787711.108914:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 319 00000100:00100000:3.0:1785787711.108948:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744884224 00000100:00100000:3.0:1785787711.108951:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744884224 00000100:00100000:3.0:1785787711.108988:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 203 00000100:00100000:3.0:1785787711.108994:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+18:2388:x1872533744884224:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1785787711.109025:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79280304-55c6-4698-bfc3-29d14648ba45+18:2388:x1872533744884224:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 31us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787711.109032:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 203 00000100:00080000:3.0:1785787711.110482:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785787711.115231:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787711.115269:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787711.115310:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787711.115335:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744884608 00000100:00100000:2.0:1785787711.115343:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744884608 00000100:00100000:2.0:1785787711.115398:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 204 00000100:00100000:2.0:1785787711.115408:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190771ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4ec65b7-e63e-42dc-becf-cba362002085+6:2389:x1872533744884608:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:2.0:1785787711.115479:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190771ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4ec65b7-e63e-42dc-becf-cba362002085+6:2389:x1872533744884608:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 73us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787711.115487:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 204 00000100:00080000:2.0:1785787711.115583:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785787711.115621:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744884480 00000100:00100000:0.0:1785787711.115626:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744884480 00000100:00100000:0.0:1785787711.115658:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744884352 00000100:00100000:0.0:1785787711.115661:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744884352 00000100:00100000:0.0:1785787711.115679:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 123 00000100:00100000:0.0:1785787711.115685:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190771ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+7:2389:x1872533744884480:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1785787711.115715:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190771ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+7:2389:x1872533744884480:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 30us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787711.115722:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 123 00000100:00100000:0.0:1785787711.115733:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 124 00000100:00100000:0.0:1785787711.115739:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190771ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+5:2389:x1872533744884352:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1785787711.115761:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190771ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79280304-55c6-4698-bfc3-29d14648ba45+5:2389:x1872533744884352:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 22us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787711.115767:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 124 00000100:00080000:2.0:1785787711.115816:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1785787711.115820:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785787711.415112:0:3334:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785787711.418691:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b6c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533770038016:0@lo:400:kworker.0 00000100:00100000:3.0:1785787711.418760:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787711.418919:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b6cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533770037888:0@lo:400:kworker.0 00000100:00100000:3.0:1785787711.418947:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787711.418987:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770037888 00000100:00100000:3.0:1785787711.418994:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770037888 00000100:00100000:3.0:1785787711.419034:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1785787711.419042:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051581050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+19:3334:x1872533770037888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787711.419090:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051581050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8642023-9103-4dbf-85d1-f204189bc871+19:3334:x1872533770037888:12345-0@lo:400:kworker.0 Request processed in 48us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787711.419097:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1785787711.422531:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b6cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533770037888:0@lo:400:kworker.0 00000100:00100000:0.0:1785787711.424616:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b6cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533770038144:0@lo:400:kworker.0 00000100:00100000:0.0:1785787711.424688:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787711.424729:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41393480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770038528:0@lo:400:kworker.0 00000100:00100000:3.0:1785787711.424762:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787711.424816:0:3334:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785787711.424823:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41391c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3334:1872533770038400:0@lo:400:kworker.0 00000100:00100000:1.0:1785787711.428902:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41393800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770038272:0@lo:400:kworker.0 00000100:00100000:1.0:1785787711.428968:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787711.429154:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770038528 00000100:00100000:0.0:1785787711.429162:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770038528 00000100:00100000:0.0:1785787711.429212:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770038272 00000100:00100000:0.0:1785787711.429215:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770038272 00000100:00100000:0.0:1785787711.429241:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1785787711.429250:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770038528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787711.429309:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770038528:12345-0@lo:400:kworker.0 Request processed in 60us (4546us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787711.429315:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1785787711.429329:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1785787711.429336:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770038272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787711.429369:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770038272:12345-0@lo:400:kworker.0 Request processed in 34us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787711.429375:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1785787711.429414:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41393800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770038272:0@lo:400:kworker.0 00000100:00100000:0.0:1785787711.429449:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787711.429585:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770038016 00000100:00100000:2.0:1785787711.429589:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770038016 00000100:00080000:3.0:1785787711.432489:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785787711.432496:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785787711.433340:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41393480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770038528:0@lo:400:kworker.0 00000100:00100000:1.0:1785787711.442321:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770038144 00000100:00100000:1.0:1785787711.442334:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770038144 00000100:00100000:1.0:1785787711.442406:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770038400 00000100:00100000:1.0:1785787711.442409:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770038400 00000100:00100000:1.0:1785787711.442426:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1785787711.442434:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533770038016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787711.442514:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533770038016:12345-0@lo:400:kworker.0 Request processed in 81us (23754us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787711.442520:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1785787711.442536:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1785787711.442543:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41392d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533770038144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787711.442574:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41392d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533770038144:12345-0@lo:400:kworker.0 Request processed in 32us (17887us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787711.442580:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1785787711.442591:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1785787711.442598:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41393800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3334:x1872533770038400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787711.442641:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41393800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3334:x1872533770038400:12345-0@lo:400:kworker.0 Request processed in 44us (13191us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787711.442647:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1785787711.444875:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41391c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3334:1872533770038400:0@lo:400:kworker.0 00000100:00100000:1.0:1785787711.444893:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b6c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533770038016:0@lo:400:kworker.0 00000100:00100000:1.0:1785787711.448923:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b6cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533770038144:0@lo:400:kworker.0 00000100:00080000:3.0:1785787711.450061:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785787711.924555:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785787711.924579:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41393480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770038656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785787711.924644:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787711.924689:0:6621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770038656 00000100:00100000:0.0:1785787711.924697:0:6621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770038656 00000100:00100000:0.0:1785787711.924739:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1785787711.924749:0:6621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190771ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770038656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785787711.924782:0:6621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785787711.924849:0:6621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190771ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770038656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787711.924856:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1785787711.924951:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41393480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770038656:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785787711.987050:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787713.011058:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785787713.972168:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785787713.972188:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fc5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770038784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785787713.972261:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787713.972462:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770038784 00000100:00100000:3.0:1785787713.972470:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770038784 00000100:00100000:3.0:1785787713.972531:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1785787713.972541:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533770038784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785787713.972571:0:6620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785787713.972615:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533770038784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787713.972621:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1785787713.972708:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fc5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770038784:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1785787713.972736:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1785787714.035705:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787715.059300:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787716.084524:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787716.230919:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787716.231026:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787716.231063:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787716.231098:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787716.231147:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744885120 00000100:00100000:1.0:1785787716.231156:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744885120 00000100:00100000:1.0:1785787716.231228:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 127 00000100:00100000:1.0:1785787716.231245:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:79280304-55c6-4698-bfc3-29d14648ba45+7:2389:x1872533744885120:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1785787716.231304:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:79280304-55c6-4698-bfc3-29d14648ba45+7:2389:x1872533744885120:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 68us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787716.231310:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 127 00000100:00100000:2.0:1785787716.231545:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744884864 00000100:00100000:2.0:1785787716.231549:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744884864 00000100:00100000:2.0:1785787716.231588:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744885248 00000100:00100000:2.0:1785787716.231591:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744885248 00000100:00100000:2.0:1785787716.231612:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 208 00000100:00100000:2.0:1785787716.231618:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+18:2389:x1872533744884864:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:2.0:1785787716.231647:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+18:2389:x1872533744884864:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 29us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787716.231653:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 208 00000100:00100000:2.0:1785787716.231667:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 209 00000100:00100000:2.0:1785787716.231673:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4ec65b7-e63e-42dc-becf-cba362002085+6:2389:x1872533744885248:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:2.0:1785787716.231694:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4ec65b7-e63e-42dc-becf-cba362002085+6:2389:x1872533744885248:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 21us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787716.231713:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 209 00000100:00080000:3.0:1785787716.232016:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1785787716.232021:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785787716.235121:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744884736 00000100:00100000:0.0:1785787716.235132:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744884736 00000100:00100000:0.0:1785787716.235294:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 321 00000100:00100000:0.0:1785787716.235304:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051580050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2389:x1872533744884736:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1785787716.235433:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051580050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2389:x1872533744884736:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 131us (4522us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787716.235441:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 321 00000100:00100000:2.0:1785787716.249617:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787716.256413:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744884992 00000100:00100000:0.0:1785787716.256426:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744884992 00000100:00100000:0.0:1785787716.256510:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 72 00000100:00100000:0.0:1785787716.256520:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190771ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:79280304-55c6-4698-bfc3-29d14648ba45+5:2387:x1872533744884992:12345-192.168.203.53@tcp:9:kworker.0 00000020:00000080:0.0:1785787716.256548:0:6619:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2c2ff68a6e847aa 00000100:00080000:0.0:1785787716.256555:0:6619:0:(import.c:65:import_set_state_nolock()) ffff9190454be800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1785787716.256589:0:6619:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1785787716.256847:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190771ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:79280304-55c6-4698-bfc3-29d14648ba45+2:2387:x1872533744884992:12345-192.168.203.53@tcp:9:kworker.0 Request processed in 328us (7237us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787716.256855:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 72 00010000:00010000:0.0:1785787716.256872:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1785787716.257386:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785787716.336199:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787716.337199:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744885504 00000100:00100000:2.0:1785787716.337209:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744885504 00000100:00100000:2.0:1785787716.337776:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 66 00000100:00100000:2.0:1785787716.337787:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+18:12358:x1872533744885504:12345-192.168.203.53@tcp:35:umount.0 00000100:00100000:2.0:1785787716.338441:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+19:12358:x1872533744885504:12345-192.168.203.53@tcp:35:umount.0 Request processed in 655us (2248us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1785787716.338449:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 66 00000100:00100000:0.0:1785787716.347735:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787716.347854:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744885760 00000100:00100000:2.0:1785787716.347863:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744885760 00000100:00100000:2.0:1785787716.347905:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 67 00000100:00100000:2.0:1785787716.347914:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41390380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+19:12358:x1872533744885760:12345-192.168.203.53@tcp:35:umount.0 00000100:00100000:2.0:1785787716.348217:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41390380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+20:12358:x1872533744885760:12345-192.168.203.53@tcp:35:umount.0 Request processed in 303us (489us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1785787716.348225:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 67 00000100:00100000:0.0:1785787716.355389:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787716.355509:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744886016 00000100:00100000:2.0:1785787716.355519:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744886016 00000100:00100000:2.0:1785787716.355571:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 68 00000100:00100000:2.0:1785787716.355581:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190451bfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+20:12358:x1872533744886016:12345-192.168.203.53@tcp:35:umount.0 00000100:00100000:2.0:1785787716.356133:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190451bfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79280304-55c6-4698-bfc3-29d14648ba45+21:12358:x1872533744886016:12345-192.168.203.53@tcp:35:umount.0 Request processed in 552us (752us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1785787716.356142:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 68 00000100:00100000:0.0:1785787716.359266:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787716.359398:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744886272 00000100:00100000:3.0:1785787716.359406:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744886272 00000100:00100000:3.0:1785787716.359453:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 69 00000100:00100000:3.0:1785787716.359461:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41393b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+21:12358:x1872533744886272:12345-192.168.203.53@tcp:35:umount.0 00000100:00100000:3.0:1785787716.360112:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41393b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79280304-55c6-4698-bfc3-29d14648ba45+22:12358:x1872533744886272:12345-192.168.203.53@tcp:35:umount.0 Request processed in 649us (851us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1785787716.360142:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 69 00000100:00100000:0.0:1785787716.375348:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787716.375438:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787716.380484:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787716.380520:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744886400 00000100:00100000:1.0:1785787716.380528:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744886400 00000100:00100000:2.0:1785787716.380583:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744886656 00000100:00100000:2.0:1785787716.380598:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744886656 00000100:00100000:2.0:1785787716.380659:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 19 00000100:00100000:2.0:1785787716.380668:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41392a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+14:2390:x1872533744886400:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785787716.380683:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785787716.380699:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919050679e00/0xe2c2ff68a6e844d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd24b expref: 14 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787716.380713:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785787716.380758:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41392a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+13:2390:x1872533744886400:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 92us (5418us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787716.380765:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 19 00000100:00100000:2.0:1785787716.380780:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 20 00000100:00100000:2.0:1785787716.380785:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41390000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+12:2390:x1872533744886656:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785787716.380792:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785787716.380800:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91904677c200/0xe2c2ff68a6e846e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd316 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787716.380808:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785787716.380822:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41390000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+11:2390:x1872533744886656:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 37us (5384us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787716.380851:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 20 00000100:00100000:0.0:1785787716.385763:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787716.385797:0:9394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744887040 00000100:00100000:0.0:1785787716.385805:0:9394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744887040 00000100:00100000:0.0:1785787716.385866:0:9394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 73 00000100:00100000:0.0:1785787716.385875:0:9394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41391500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:79280304-55c6-4698-bfc3-29d14648ba45+7:2387:x1872533744887040:12345-192.168.203.53@tcp:9:umount.0 00000020:00000080:0.0:1785787716.385903:0:9394:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2c2ff68a6e84a0b 00000020:00010000:0.0:1785787716.385912:0:9394:0:(genops.c:1942:obd_stale_export_put()) Put export ffff919077851800: total 0 00000100:00080000:0.0:1785787716.385915:0:9394:0:(import.c:65:import_set_state_nolock()) ffff919077854000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1785787716.385949:0:9394:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1785787716.386141:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744886528 00000100:00100000:1.0:1785787716.386146:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744886528 00000100:00100000:1.0:1785787716.386177:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 21 00000100:00100000:1.0:1785787716.386184:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41390a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+11:2390:x1872533744886528:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785787716.386202:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785787716.386230:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91905f902e00/0xe2c2ff68a6e84438 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd213 expref: 11 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787716.386259:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785787716.386302:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41390a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:2390:x1872533744886528:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 118us (5826us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787716.386309:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 21 00000020:00010000:1.0:1785787716.386386:0:5809:0:(genops.c:1928:obd_stale_export_get()) Get export ffff919077851800: total 0 00010000:00010000:1.0:1785787716.386415:0:5809:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff919077851800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1785787716.386450:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000fda141e/0xe2c2ff68a6e84dae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4eb expref: 6 pid: 6617 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787716.386477:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051f52044/0xe2c2ff68a6e8544c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd6b9 expref: 5 pid: 6618 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787716.386493:0:5809:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff919077851800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1785787716.386502:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787716.386505:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787716.386507:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787716.387360:0:9394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41391500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:79280304-55c6-4698-bfc3-29d14648ba45+2:2387:x1872533744887040:12345-192.168.203.53@tcp:9:umount.0 Request processed in 1483us (1601us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787716.387382:0:9394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 73 00000100:00100000:1.0:1785787716.401008:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787716.401174:0:9295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744888064 00000100:00100000:2.0:1785787716.401184:0:9295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744888064 00000100:00100000:2.0:1785787716.401243:0:9295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 240 00000100:00100000:2.0:1785787716.401253:0:9295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+22:2387:x1872533744888064:12345-192.168.203.53@tcp:39:umount.0 00000020:00000080:2.0:1785787716.401284:0:9295:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2c2ff68a6e84446 00000020:00010000:2.0:1785787716.401299:0:9295:0:(genops.c:1942:obd_stale_export_put()) Put export ffff919077067000: total 0 00000100:00080000:2.0:1785787716.401316:0:9295:0:(import.c:65:import_set_state_nolock()) ffff919077061800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1785787716.401352:0:9295:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:2.0:1785787716.401863:0:9295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79280304-55c6-4698-bfc3-29d14648ba45+21:2387:x1872533744888064:12345-192.168.203.53@tcp:39:umount.0 Request processed in 610us (864us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1785787716.401871:0:9295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 240 00000020:00010000:1.0:1785787716.402223:0:5808:0:(genops.c:1928:obd_stale_export_get()) Get export ffff919077067000: total 0 00010000:00010000:1.0:1785787716.402270:0:5808:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff919077067000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1785787716.402298:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919055acd300) 00010000:00010000:1.0:1785787716.402301:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1785787716.402309:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e84c8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd49e expref: 20 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787716.402342:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9190481f9e00) 00010000:00010000:1.0:1785787716.402345:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1785787716.402350:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d400/0xe2c2ff68a6e84780 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd340 expref: 19 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787716.402364:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91905685ff00) 00010000:00010000:1.0:1785787716.402366:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1785787716.402370:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e8532d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd66c expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787716.402384:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff919059e3e900) 00010000:00010000:1.0:1785787716.402386:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1785787716.402390:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919050678000/0xe2c2ff68a6e84e2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd50e expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787716.402402:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9190481f9400) 00010000:00010000:1.0:1785787716.402404:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785787716.402408:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c600/0xe2c2ff68a6e8472c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd32b expref: 16 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787716.402425:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9190481f9b00) 00010000:00010000:1.0:1785787716.402427:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785787716.402431:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d200/0xe2c2ff68a6e84e10 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd507 expref: 15 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787716.402443:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91905685ff00) 00010000:00010000:1.0:1785787716.402445:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1785787716.402457:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d800/0xe2c2ff68a6e85437 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd6b2 expref: 14 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787716.402470:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919055acd300) 00010000:00010000:1.0:1785787716.402473:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785787716.402476:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677dc00/0xe2c2ff68a6e84d6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4d6 expref: 13 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787716.402487:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff919055acd300) 00010000:00010000:1.0:1785787716.402489:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1785787716.402493:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e400/0xe2c2ff68a6e84d99 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd4e4 expref: 12 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787716.402506:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91905685ff00) 00010000:00010000:1.0:1785787716.402508:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785787716.402514:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f600/0xe2c2ff68a6e8540d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd6a4 expref: 11 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787716.402529:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9190481f9e00) 00010000:00010000:1.0:1785787716.402531:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1785787716.402535:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903400/0xe2c2ff68a6e84a6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd412 expref: 10 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787716.402549:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91905685f200) 00010000:00010000:1.0:1785787716.402551:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785787716.402554:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919043c0e800/0xe2c2ff68a6e84710 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd324 expref: 9 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787716.402568:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff919059e3e900) 00010000:00010000:1.0:1785787716.402588:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1785787716.402594:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e8510b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd5e0 expref: 8 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787716.402610:0:5808:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff919077067000, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1785787716.402622:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787716.402623:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787716.402625:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785787716.531157:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41392680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533770038912:0@lo:400:kworker.0 00000100:00100000:1.0:1785787716.531248:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787716.531313:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41391f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3333:1872533770039424:0@lo:400:kworker.0 00000100:00100000:1.0:1785787716.531340:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787716.531368:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1785787716.531374:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41390e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1872533770039040:0@lo:400:kworker.0 00000100:00100000:1.0:1785787716.531395:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787716.531411:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41390700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770039552:0@lo:400:kworker.0 00000100:00100000:1.0:1785787716.531433:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787716.531465:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770039424 00000100:00100000:1.0:1785787716.531472:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770039424 00000100:00100000:1.0:1785787716.531521:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770039040 00000100:00100000:1.0:1785787716.531524:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770039040 00000100:00100000:1.0:1785787716.531545:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1785787716.531553:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1872533770039424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787716.531600:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1872533770039424:12345-0@lo:400:kworker.0 Request processed in 48us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787716.531607:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1785787716.531624:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1785787716.531643:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1872533770039040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787716.531672:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1872533770039040:12345-0@lo:400:kworker.0 Request processed in 30us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787716.531677:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00080000:1.0:1785787716.531698:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785787716.531722:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41390e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1872533770039040:0@lo:400:kworker.0 00000100:00100000:1.0:1785787716.531732:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41391f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3333:1872533770039424:0@lo:400:kworker.0 00000100:00100000:1.0:1785787716.531758:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770039552 00000100:00100000:1.0:1785787716.531761:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770039552 00000100:00100000:1.0:1785787716.531791:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1785787716.531797:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770039552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787716.531860:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770039552:12345-0@lo:400:kworker.0 Request processed in 62us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787716.531866:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:1.0:1785787716.531892:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785787716.531907:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41390700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770039552:0@lo:400:kworker.0 00000100:00100000:0.0:1785787716.532068:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770038912 00000100:00100000:0.0:1785787716.532073:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770038912 00000100:00100000:0.0:1785787716.532105:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1785787716.532111:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051583c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+19:3333:x1872533770038912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787716.532157:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051583c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8642023-9103-4dbf-85d1-f204189bc871+19:3333:x1872533770038912:12345-0@lo:400:kworker.0 Request processed in 46us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787716.532163:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1785787716.532395:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41393100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770039296:0@lo:400:kworker.0 00000100:00100000:2.0:1785787716.532424:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787716.532448:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785787716.532454:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41392300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3336:1872533770039168:0@lo:400:kworker.0 00000100:00100000:2.0:1785787716.532472:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787716.532529:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770039296 00000100:00100000:0.0:1785787716.532532:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770039296 00000100:00100000:0.0:1785787716.532567:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1785787716.532573:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190771ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770039296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787716.532605:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190771ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770039296:12345-0@lo:400:kworker.0 Request processed in 32us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787716.532611:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:2.0:1785787716.532710:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785787716.532730:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41393100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770039296:0@lo:400:kworker.0 00000100:00100000:1.0:1785787716.532820:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770039168 00000100:00100000:1.0:1785787716.532824:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770039168 00000100:00100000:1.0:1785787716.532875:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1785787716.532881:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9190771eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3336:x1872533770039168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787716.532914:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9190771eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3336:x1872533770039168:12345-0@lo:400:kworker.0 Request processed in 33us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787716.532919:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1785787716.532939:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41392300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3336:1872533770039168:0@lo:400:kworker.0 00000100:00100000:1.0:1785787716.532959:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41392680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533770038912:0@lo:400:kworker.0 00000100:00080000:2.0:1785787716.533022:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785787717.045606:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41391880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770039680:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785787717.045670:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787717.045788:0:6621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770039680 00000100:00100000:0.0:1785787717.045794:0:6621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770039680 00000100:00100000:0.0:1785787717.045875:0:6621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1785787717.045884:0:6621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fc5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533770039680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785787717.045913:0:6621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785787717.045959:0:6621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fc5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533770039680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787717.045967:0:6621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1785787717.046048:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41391880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770039680:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1785787717.107057:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787718.131099:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785787719.091355:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076d89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770039808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785787719.091424:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787719.091551:0:8140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770039808 00000100:00100000:3.0:1785787719.091558:0:8140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770039808 00000100:00100000:3.0:1785787719.091615:0:8140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1785787719.091626:0:8140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770039808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785787719.091658:0:8140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785787719.091701:0:8140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770039808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787719.091708:0:8140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:1.0:1785787719.091761:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785787719.091792:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076d89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770039808:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1785787719.155868:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1785787719.656749:0:5843:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 79280304-55c6-4698-bfc3-29d14648ba45 00000001:00080000:2.0:1785787719.656766:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:2.0:1785787719.656777:0:5843:0:(genops.c:906:class_export_put()) final put ffff919077067000/79280304-55c6-4698-bfc3-29d14648ba45 00000020:00000080:2.0:1785787719.656797:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff919077067000/79280304-55c6-4698-bfc3-29d14648ba45 for lustre-MDT0000 00000020:00000080:2.0:1785787719.656868:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff919077061800 for lustre-MDT0000 00000001:00100000:0.0:1785787719.684050:0:6642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 79280304-55c6-4698-bfc3-29d14648ba45 00000020:00000080:0.0:1785787719.684059:0:6642:0:(genops.c:906:class_export_put()) final put ffff919055565000/79280304-55c6-4698-bfc3-29d14648ba45 00000020:00000080:2.0:1785787719.684285:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff919055565000/79280304-55c6-4698-bfc3-29d14648ba45 for lustre-OST0000 00000020:00000080:2.0:1785787719.684321:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9190454be800 for lustre-OST0000 00000040:00080000:1.0:1785787720.051905:0:11564:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1785787720.051914:0:11564:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1785787720.053258:0:11564:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1785787720.053268:0:11564:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1785787720.183259:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1785787720.375862:0:7522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 79280304-55c6-4698-bfc3-29d14648ba45 00000020:00000080:3.0:1785787720.375870:0:7522:0:(genops.c:906:class_export_put()) final put ffff919077851800/79280304-55c6-4698-bfc3-29d14648ba45 00000020:00000080:3.0:1785787720.375904:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff919077851800/79280304-55c6-4698-bfc3-29d14648ba45 for lustre-OST0001 00000020:00000080:3.0:1785787720.375949:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff919077854000 for lustre-OST0001 00000100:00100000:1.0:1785787720.806445:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787720.806483:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787720.806516:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787720.806589:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744888192 00000100:00100000:2.0:1785787720.806598:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744888448 00000100:00100000:3.0:1785787720.806599:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744888192 00000100:00100000:2.0:1785787720.806606:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744888448 00000100:00100000:3.0:1785787720.806663:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744888320 00000100:00100000:3.0:1785787720.806667:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744888320 00000100:00100000:0.0:1785787720.806681:0:11051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 22 00000100:00100000:0.0:1785787720.806693:0:11051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+12:2389:x1872533744888192:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785787720.806708:0:11051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785787720.806726:0:11051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919043c0ee00/0xe2c2ff68a6e84518 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd260 expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787720.806742:0:11051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785787720.806792:0:11051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+11:2389:x1872533744888192:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 102us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787720.806799:0:11051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 22 00000100:00100000:2.0:1785787720.810338:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 23 00000100:00100000:2.0:1785787720.810356:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b6c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+11:2389:x1872533744888448:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785787720.810384:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785787720.810400:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91905f903c00/0xe2c2ff68a6e846df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd30f expref: 11 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787720.810415:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785787720.810464:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b6c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+10:2389:x1872533744888448:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 116us (3981us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787720.811346:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 23 00000100:00100000:3.0:1785787720.819974:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 24 00000100:00100000:3.0:1785787720.819991:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051467050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+9:2389:x1872533744888320:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785787720.820008:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787720.820027:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919050678200/0xe2c2ff68a6e8451f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd28a expref: 9 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787720.820043:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787720.820110:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051467050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+8:2389:x1872533744888320:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 126us (13593us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787720.820118:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 24 00000100:00100000:3.0:1785787720.820653:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787720.820679:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744888704 00000100:00100000:3.0:1785787720.820686:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744888704 00000100:00100000:3.0:1785787720.820731:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 241 00000100:00100000:3.0:1785787720.820739:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076d8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4ec65b7-e63e-42dc-becf-cba362002085+6:2387:x1872533744888704:12345-192.168.203.53@tcp:39:umount.0 00000020:00000080:3.0:1785787720.820771:0:5822:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2c2ff68a6e8452d 00000020:00010000:3.0:1785787720.820777:0:5822:0:(genops.c:1942:obd_stale_export_put()) Put export ffff919045c79800: total 0 00000100:00080000:3.0:1785787720.820781:0:5822:0:(import.c:65:import_set_state_nolock()) ffff91905fadc800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1785787720.820802:0:5822:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1785787720.821254:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076d8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4ec65b7-e63e-42dc-becf-cba362002085+5:2387:x1872533744888704:12345-192.168.203.53@tcp:39:umount.0 Request processed in 514us (601us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1785787720.821261:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 241 00000100:00080000:3.0:1785787720.821279:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:3.0:1785787720.821289:0:5809:0:(genops.c:1928:obd_stale_export_get()) Get export ffff919045c79800: total 0 00010000:00010000:3.0:1785787720.821293:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787720.821323:0:5809:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff919045c79800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1785787720.821349:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9190481f9b00) 00010000:00010000:3.0:1785787720.821352:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785787720.821359:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677da00/0xe2c2ff68a6e8545a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd6c0 expref: 4 pid: 9295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787720.821381:0:5809:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff919045c79800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1785787720.821388:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787720.821390:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787720.821392:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787720.879785:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787720.880763:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744888960 00000100:00100000:0.0:1785787720.880774:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744888960 00000100:00100000:0.0:1785787720.880917:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 323 00000100:00100000:2.0:1785787720.880991:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051582c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+7:2387:x1872533744888960:12345-192.168.203.53@tcp:251:umount.0 00000020:00000080:2.0:1785787720.881035:0:5813:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2c2ff68a6e84423 00000020:00010000:2.0:1785787720.881043:0:5813:0:(genops.c:1942:obd_stale_export_put()) Put export ffff919077060000: total 0 00000100:00080000:2.0:1785787720.881047:0:5813:0:(import.c:65:import_set_state_nolock()) ffff919077062000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1785787720.881118:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051582c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ee04e69-b6fb-4c5f-9b75-18b5c664ac28+3:2387:x1872533744888960:12345-192.168.203.53@tcp:251:umount.0 Request processed in 192us (1340us total) trans 0 rc 0/0 00000020:00010000:1.0:1785787720.881157:0:5808:0:(genops.c:1928:obd_stale_export_get()) Get export ffff919077060000: total 0 00010000:00010000:1.0:1785787720.881198:0:5808:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff919077060000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1785787720.881233:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919043c0f800/0xe2c2ff68a6e844d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd252 expref: 3 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787720.881248:0:5808:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff919077060000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1785787720.881257:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787720.881260:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787720.881261:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785787720.894570:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 323 00000020:00000080:2.0:1785787720.894595:0:5813:0:(genops.c:906:class_export_put()) final put ffff919077060000/2ee04e69-b6fb-4c5f-9b75-18b5c664ac28 00000020:00000080:3.0:1785787720.894819:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff919077060000/2ee04e69-b6fb-4c5f-9b75-18b5c664ac28 for MGS 00000020:00000080:3.0:1785787720.894882:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff919077062000 for MGS 00010000:00010000:2.0:1785787721.204317:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787721.651185:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076d8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533770040064:0@lo:400:kworker.0 00000100:00100000:0.0:1785787721.651258:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787721.651311:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076d8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770040576:0@lo:400:kworker.0 00000100:00100000:0.0:1785787721.651332:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787721.651373:0:3334:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1785787721.651379:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076d89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533770039936:0@lo:400:kworker.0 00000100:00100000:0.0:1785787721.651403:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787721.651421:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076d8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3334:1872533770040448:0@lo:400:kworker.0 00000100:00100000:0.0:1785787721.651438:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787721.651465:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770040064 00000100:00100000:0.0:1785787721.651473:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770040064 00000100:00100000:0.0:1785787721.651510:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770040448 00000100:00100000:0.0:1785787721.651513:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770040448 00000100:00100000:0.0:1785787721.651537:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1785787721.651544:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41392a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533770040064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787721.651593:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41392a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533770040064:12345-0@lo:400:kworker.0 Request processed in 49us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787721.651600:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1785787721.651616:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1785787721.651622:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41390a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3334:x1872533770040448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787721.651647:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41390a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3334:x1872533770040448:12345-0@lo:400:kworker.0 Request processed in 25us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787721.651653:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1785787721.651685:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076d8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3334:1872533770040448:0@lo:400:kworker.0 00000100:00100000:0.0:1785787721.651695:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076d8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533770040064:0@lo:400:kworker.0 00000100:00100000:0.0:1785787721.651728:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770040576 00000100:00100000:0.0:1785787721.651732:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770040576 00000100:00100000:0.0:1785787721.651757:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1785787721.651763:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41390000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770040576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787721.651793:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41390000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770040576:12345-0@lo:400:kworker.0 Request processed in 31us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787721.651805:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1785787721.651821:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076d88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770040320:0@lo:400:kworker.0 00000100:00100000:0.0:1785787721.651863:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787721.651878:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785787721.651883:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076d8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3336:1872533770040192:0@lo:400:kworker.0 00000100:00100000:0.0:1785787721.651900:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787721.651917:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770040320 00000100:00100000:0.0:1785787721.651920:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770040320 00000100:00100000:0.0:1785787721.651942:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1785787721.651948:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41391180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770040320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787721.651977:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41391180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770040320:12345-0@lo:400:kworker.0 Request processed in 29us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787721.651983:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1785787721.652018:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076d88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770040320:0@lo:400:kworker.0 00000100:00100000:3.0:1785787721.652096:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770040192 00000100:00100000:3.0:1785787721.652100:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770040192 00000100:00100000:3.0:1785787721.652121:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1785787721.652127:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41391880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3336:x1872533770040192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787721.652157:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41391880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3336:x1872533770040192:12345-0@lo:400:kworker.0 Request processed in 31us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787721.652163:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00080000:3.0:1785787721.652181:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785787721.652184:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785787721.652186:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785787721.652917:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076d8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3336:1872533770040192:0@lo:400:kworker.0 00000100:00100000:0.0:1785787721.652942:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076d8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770040576:0@lo:400:kworker.0 00000100:00100000:0.0:1785787721.652963:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770039936 00000100:00100000:0.0:1785787721.652966:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770039936 00000100:00100000:0.0:1785787721.653110:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1785787721.653118:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919051581850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+19:3334:x1872533770039936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787721.653163:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919051581850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8642023-9103-4dbf-85d1-f204189bc871+19:3334:x1872533770039936:12345-0@lo:400:kworker.0 Request processed in 46us (1758us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787721.653169:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1785787721.655188:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076d89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533770039936:0@lo:400:kworker.0 00000100:00100000:3.0:1785787722.164211:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770040704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785787722.164298:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787722.164869:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770040704 00000100:00100000:2.0:1785787722.164876:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770040704 00000100:00100000:2.0:1785787722.164920:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1785787722.164929:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076d88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533770040704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785787722.164963:0:6620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1785787722.165021:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076d88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533770040704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787722.165029:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1785787722.165687:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770040704:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1785787722.228415:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787723.266458:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1785787723.321736:0:12951:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1785787723.345958:0:12951:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1785787723.346009:0:12951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff91905f902200/0xe2c2ff68a6e844a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e844af expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787723.346024:0:12951:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff91905f902200/0xe2c2ff68a6e844a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e844af expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787723.346031:0:12951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff91905f902200/0xe2c2ff68a6e844a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2c2ff68a6e844af expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787723.346038:0:12951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.153@tcp lock: ffff91905f902200/0xe2c2ff68a6e844a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2c2ff68a6e844af expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787723.346059:0:12951:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1785787723.346064:0:12951:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1785787723.346082:0:12951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1785787723.346086:0:12951:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1785787723.346090:0:12951:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1785787723.346112:0:12951:0:(import.c:65:import_set_state_nolock()) ffff919056aaa800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1785787723.346310:0:3332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41392680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3332:1872533770040832:0@lo:39:umount.0 00000100:00100000:3.0:1785787723.346493:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1785787723.346608:0:11050:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785787723.346615:0:11050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff91905f902200/0xe2c2ff68a6e844a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2c2ff68a6e844af expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787723.346624:0:11050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f902200 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:2.0:1785787723.346628:0:11050:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff91905f902200/0xe2c2ff68a6e844a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2c2ff68a6e844af expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787723.346636:0:11050:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff91905f902200/0xe2c2ff68a6e844a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2c2ff68a6e844af expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785787723.346643:0:11050:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff91905f902200/0xe2c2ff68a6e844a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2c2ff68a6e844af expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785787723.346648:0:11050:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1785787723.346650:0:11050:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1785787723.346652:0:11050:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1785787723.346676:0:11050:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff91905f902200/0xe2c2ff68a6e844a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2c2ff68a6e844af expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787723.346682:0:11050:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785787723.346710:0:11050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff91905f902200/0xe2c2ff68a6e844a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2c2ff68a6e844af expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787723.346717:0:11050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff91905f902200/0xe2c2ff68a6e844a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2c2ff68a6e844af expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787723.346790:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787723.346792:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787723.346794:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787723.346858:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785787723.346869:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8642023-9103-4dbf-85d1-f204189bc871:3335:1872533770040960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785787723.346899:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787723.346972:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770040960 00000100:00100000:2.0:1785787723.346999:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770040960 00000100:00100000:2.0:1785787723.347235:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1785787723.347245:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076d89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8642023-9103-4dbf-85d1-f204189bc871+19:3335:x1872533770040960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785787723.347258:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785787723.347272:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919050679000/0xe2c2ff68a6e844af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2c2ff68a6e844a8 expref: 19 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787723.347284:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785787723.347320:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076d89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8642023-9103-4dbf-85d1-f204189bc871+18:3335:x1872533770040960:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787723.351193:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770040832 00000100:00100000:1.0:1785787723.351209:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770040832 00000100:00100000:1.0:1785787723.351276:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1785787723.351286:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076d88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3332:x1872533770040832:12345-0@lo:39:umount.0 00000020:00000080:1.0:1785787723.351330:0:5821:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2c2ff68a6e84232 00000100:00080000:1.0:1785787723.351338:0:5821:0:(import.c:65:import_set_state_nolock()) ffff9190490ec000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1785787723.351445:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076d88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3332:x1872533770040832:12345-0@lo:39:umount.0 Request processed in 160us (4950us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787723.351454:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1785787723.351463:0:5821:0:(genops.c:906:class_export_put()) final put ffff9190490ea800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1785787723.351486:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1785787723.351516:0:3332:0:(import.c:65:import_set_state_nolock()) ffff919056aaa800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1785787723.351525:0:3332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41392680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3332:1872533770040832:0@lo:39:umount.0 00000020:00000080:1.0:1785787723.351550:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9190490ea800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1785787723.351592:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9190490ec000 for lustre-MDT0000 00000100:00080000:0.0:1785787723.351804:0:12951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1785787723.351808:0:12951:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1785787723.351812:0:12951:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1785787723.352732:0:12951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff919050678e00/0xe2c2ff68a6e844b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e844bd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787723.352746:0:12951:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff919050678e00/0xe2c2ff68a6e844b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e844bd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787723.352753:0:12951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff919050678e00/0xe2c2ff68a6e844b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2c2ff68a6e844bd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787723.352771:0:12951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.153@tcp lock: ffff919050678e00/0xe2c2ff68a6e844b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2c2ff68a6e844bd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787723.352785:0:12951:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785787723.352790:0:12951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff919040030e00/0xe2c2ff68a6e843dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e843e4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787723.352796:0:12951:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff919040030e00/0xe2c2ff68a6e843dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e843e4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787723.352802:0:12951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff919040030e00/0xe2c2ff68a6e843dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2c2ff68a6e843e4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787723.352807:0:12951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.153@tcp lock: ffff919040030e00/0xe2c2ff68a6e843dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2c2ff68a6e843e4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787723.352825:0:12951:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1785787723.352847:0:12951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff91905f902a00/0xe2c2ff68a6e846d1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e846d8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787723.352854:0:12951:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff91905f902a00/0xe2c2ff68a6e846d1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e846d8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787723.352859:0:12951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff91905f902a00/0xe2c2ff68a6e846d1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2c2ff68a6e846d8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787723.352864:0:12951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.153@tcp lock: ffff91905f902a00/0xe2c2ff68a6e846d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2c2ff68a6e846d8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787723.352882:0:12951:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1785787723.352888:0:12951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff91908206be00/0xe2c2ff68a6e84191 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84198 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787723.352894:0:12951:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff91908206be00/0xe2c2ff68a6e84191 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e84198 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787723.352899:0:12951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff91908206be00/0xe2c2ff68a6e84191 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2c2ff68a6e84198 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787723.352905:0:12951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.153@tcp lock: ffff91908206be00/0xe2c2ff68a6e84191 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2c2ff68a6e84198 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787723.352910:0:12951:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1785787723.352913:0:12951:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1785787723.352934:0:12951:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1785787723.352938:0:12951:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1785787723.352941:0:12951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1785787723.352945:0:12951:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:0.0:1785787723.352949:0:12951:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff919077067800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1785787723.352955:0:12951:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff91907fe6a800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1785787723.352962:0:12951:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff919045c79800 f4ec65b7-e63e-42dc-becf-cba362002085 192.168.203.53@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1785787723.352967:0:12951:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff91904e8719c0) has exports, disconnecting them 00000020:00080000:0.0:1785787723.352971:0:12951:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff919077067800), last request at 1785787721 00000020:00000080:0.0:1785787723.352976:0:12951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2c2ff68a6e843a5 00000100:00080000:0.0:1785787723.352988:0:12951:0:(import.c:65:import_set_state_nolock()) ffff919077062800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1785787723.353024:0:12951:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff919077067800): rc 0 00000020:00000080:0.0:1785787723.353032:0:12951:0:(genops.c:906:class_export_put()) final put ffff919077067800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1785787723.353039:0:12951:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff91907fe6a800), last request at 1785787721 00000020:00000080:0.0:1785787723.353043:0:12951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2c2ff68a6e842da 00000100:00080000:0.0:1785787723.353047:0:12951:0:(import.c:65:import_set_state_nolock()) ffff91907fe6b800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1785787723.353054:0:12951:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff91907fe6a800): rc 0 00000020:00000080:0.0:1785787723.353056:0:12951:0:(genops.c:906:class_export_put()) final put ffff91907fe6a800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1785787723.353062:0:12951:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb1fe0226bae0 00000100:00080000:0.0:1785787723.353078:0:12951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1785787723.353081:0:12951:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1785787723.353092:0:12951:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1785787723.353159:0:12951:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1785787723.353176:0:12951:0:(import.c:65:import_set_state_nolock()) ffff91907fe6e000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1785787723.353198:0:12951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1785787723.353200:0:12951:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1785787723.353209:0:12951:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1785787723.353268:0:12951:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1785787723.353276:0:12951:0:(import.c:65:import_set_state_nolock()) ffff919045c7d800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1785787723.353300:0:12951:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff91904e8719c0) has no exports 00010000:00010000:1.0:1785787723.354083:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1785787723.354090:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff919050678e00/0xe2c2ff68a6e844b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2c2ff68a6e844bd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787723.354099:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919050678e00 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:1.0:1785787723.354103:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff919050678e00/0xe2c2ff68a6e844b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2c2ff68a6e844bd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787723.354113:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff919050678e00/0xe2c2ff68a6e844b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2c2ff68a6e844bd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785787723.354121:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff919050678e00/0xe2c2ff68a6e844b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2c2ff68a6e844bd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785787723.354127:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1785787723.354129:0:5808:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:1.0:1785787723.354132:0:5808:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1785787723.354170:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff919050678e00/0xe2c2ff68a6e844b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2c2ff68a6e844bd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787723.354177:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785787723.354205:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff919050678e00/0xe2c2ff68a6e844b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2c2ff68a6e844bd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787723.354212:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff919050678e00/0xe2c2ff68a6e844b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2c2ff68a6e844bd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787723.354223:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1785787723.354227:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff919040030e00/0xe2c2ff68a6e843dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2c2ff68a6e843e4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787723.354232:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919040030e00 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:1.0:1785787723.354235:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff919040030e00/0xe2c2ff68a6e843dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2c2ff68a6e843e4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787723.354241:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff919040030e00/0xe2c2ff68a6e843dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2c2ff68a6e843e4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785787723.354247:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff919040030e00/0xe2c2ff68a6e843dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2c2ff68a6e843e4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785787723.354252:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1785787723.354255:0:5808:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1785787723.354256:0:5808:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1785787723.354266:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff919040030e00/0xe2c2ff68a6e843dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2c2ff68a6e843e4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787723.354272:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785787723.354277:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff919040030e00/0xe2c2ff68a6e843dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2c2ff68a6e843e4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787723.354290:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff919040030e00/0xe2c2ff68a6e843dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2c2ff68a6e843e4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787723.354302:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1785787723.354305:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff91905f902a00/0xe2c2ff68a6e846d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2c2ff68a6e846d8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787723.354310:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f902a00 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:1.0:1785787723.354313:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff91905f902a00/0xe2c2ff68a6e846d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2c2ff68a6e846d8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787723.354320:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff91905f902a00/0xe2c2ff68a6e846d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2c2ff68a6e846d8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785787723.354325:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff91905f902a00/0xe2c2ff68a6e846d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2c2ff68a6e846d8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785787723.354331:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1785787723.354333:0:5808:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1785787723.354335:0:5808:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1785787723.354348:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff91905f902a00/0xe2c2ff68a6e846d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2c2ff68a6e846d8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787723.354354:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785787723.354377:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff91905f902a00/0xe2c2ff68a6e846d1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2c2ff68a6e846d8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787723.354384:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff91905f902a00/0xe2c2ff68a6e846d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2c2ff68a6e846d8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787723.354402:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785787723.354405:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff91908206be00/0xe2c2ff68a6e84191 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2c2ff68a6e84198 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787723.354410:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91908206be00 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:1.0:1785787723.354413:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff91908206be00/0xe2c2ff68a6e84191 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2c2ff68a6e84198 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787723.354421:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff91908206be00/0xe2c2ff68a6e84191 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2c2ff68a6e84198 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785787723.354427:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff91908206be00/0xe2c2ff68a6e84191 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2c2ff68a6e84198 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785787723.354589:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1785787723.354591:0:5808:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1785787723.354593:0:5808:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1785787723.354610:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff91908206be00/0xe2c2ff68a6e84191 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2c2ff68a6e84198 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787723.354617:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785787723.354623:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff91908206be00/0xe2c2ff68a6e84191 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2c2ff68a6e84198 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787723.354630:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff91908206be00/0xe2c2ff68a6e84191 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2c2ff68a6e84198 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787723.354642:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787723.354644:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787723.354650:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787723.354657:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785787723.354669:0:3332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41392300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3332:1872533770041088:0@lo:9:umount.0 00000100:00100000:1.0:1785787723.354729:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787723.354755:0:3332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41393100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3332:1872533770041216:0@lo:9:umount.0 00000100:00100000:1.0:1785787723.354777:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787723.354810:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b48c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8642023-9103-4dbf-85d1-f204189bc871:3336:1872533770041728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785787723.354862:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787723.354891:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785787723.354897:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b6c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8642023-9103-4dbf-85d1-f204189bc871:3336:1872533770041600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785787723.354918:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787723.354940:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770041088 00000100:00100000:1.0:1785787723.354945:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770041088 00000100:00100000:1.0:1785787723.354983:0:6619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770041216 00000100:00100000:1.0:1785787723.354986:0:6619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770041216 00000100:00100000:1.0:1785787723.355385:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1785787723.355393:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076edf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3332:x1872533770041088:12345-0@lo:9:umount.0 00000020:00000080:1.0:1785787723.355412:0:6619:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2c2ff68a6e84327 00000100:00080000:1.0:1785787723.355417:0:6619:0:(import.c:65:import_set_state_nolock()) ffff919048213800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1785787723.355540:0:6619:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1785787723.355906:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076edf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3332:x1872533770041088:12345-0@lo:9:umount.0 Request processed in 513us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787723.355914:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1785787723.355927:0:6619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1785787723.355934:0:6619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41d9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3332:x1872533770041216:12345-0@lo:9:umount.0 00000020:00000080:1.0:1785787723.355945:0:6619:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2c2ff68a6e8440e 00000100:00080000:1.0:1785787723.355951:0:6619:0:(import.c:65:import_set_state_nolock()) ffff91905fadc000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1785787723.355976:0:6619:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1785787723.356140:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b6cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533770041344:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785787723.356177:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787723.356201:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785787723.356208:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b6c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533770041472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785787723.356227:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787723.356795:0:6619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41d9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3332:x1872533770041216:12345-0@lo:9:umount.0 Request processed in 859us (2015us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787723.356802:0:6619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1785787723.356824:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770041728 00000100:00080000:0.0:1785787723.356880:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785787723.356884:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785787723.356893:0:11051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770041600 00000100:00100000:0.0:1785787723.356897:0:11051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770041600 00000100:00100000:3.0:1785787723.356973:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770041344 00000100:00100000:3.0:1785787723.356978:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770041344 00000100:00100000:3.0:1785787723.357007:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770041472 00000100:00100000:3.0:1785787723.357010:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770041472 00000100:00100000:3.0:1785787723.357025:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1785787723.357031:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41390700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8642023-9103-4dbf-85d1-f204189bc871+21:3333:x1872533770041344:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785787723.357123:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770041728 00010000:00010000:1.0:1785787723.357145:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1785787723.357233:0:3332:0:(import.c:65:import_set_state_nolock()) ffff91907fe6e000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1785787723.357246:0:3332:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1785787723.357248:0:3332:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1785787723.357251:0:3332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41392300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3332:1872533770041088:0@lo:9:umount.0 00000100:00080000:1.0:1785787723.357262:0:3332:0:(import.c:65:import_set_state_nolock()) ffff919045c7d800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1785787723.357265:0:3332:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1785787723.357266:0:3332:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1785787723.357269:0:3332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41393100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3332:1872533770041216:0@lo:9:umount.0 00010000:00010000:1.0:1785787723.357296:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787723.357730:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787723.357752:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9190413a1400/0xe2c2ff68a6e844bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2c2ff68a6e844b6 expref: 22 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787723.357766:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787723.357805:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41390700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8642023-9103-4dbf-85d1-f204189bc871+21:3333:x1872533770041344:12345-0@lo:103:ldlm_bl.0 Request processed in 774us (1627us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787723.357812:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1785787723.357844:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1785787723.357851:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41391f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8642023-9103-4dbf-85d1-f204189bc871+20:3333:x1872533770041472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785787723.357859:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787723.357867:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919043c0f600/0xe2c2ff68a6e843e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2c2ff68a6e843dd expref: 20 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787723.357879:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787723.357899:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41391f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8642023-9103-4dbf-85d1-f204189bc871+19:3333:x1872533770041472:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (1671us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787723.357905:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1785787723.357927:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1785787723.357933:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8642023-9103-4dbf-85d1-f204189bc871+18:3336:x1872533770041728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785787723.357940:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787723.357948:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91908206b400/0xe2c2ff68a6e84198 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2c2ff68a6e84191 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787723.357959:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787723.358413:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8642023-9103-4dbf-85d1-f204189bc871+17:3336:x1872533770041728:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (3121us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787723.358486:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1785787723.358608:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1785787723.358629:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785787723.358651:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8642023-9103-4dbf-85d1-f204189bc871:3335:1872533770040960:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1785787723.358973:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff919077067800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1785787723.359025:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff91907fe6a800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1785787723.359046:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff919077062800 for lustre-MDT0000 00000020:00000080:2.0:1785787723.359146:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91907fe6b800 for lustre-MDT0000 00000100:00100000:1.0:1785787723.359268:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b6c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533770041472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785787723.359277:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b6cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8642023-9103-4dbf-85d1-f204189bc871:3333:1872533770041344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785787723.359298:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b48c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8642023-9103-4dbf-85d1-f204189bc871:3336:1872533770041728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785787723.364176:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1785787723.364204:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d8642023-9103-4dbf-85d1-f204189bc871+15:3336:x1872533770041600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785787723.364229:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785787723.364256:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91904677c000/0xe2c2ff68a6e846d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2c2ff68a6e846d1 expref: 15 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787723.364271:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785787723.364359:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d8642023-9103-4dbf-85d1-f204189bc871+14:3336:x1872533770041600:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (9440us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787723.364373:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1785787723.364601:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b6c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8642023-9103-4dbf-85d1-f204189bc871:3336:1872533770041600:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1785787723.386076:0:12951:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff91904e8719c0) has no exports 00000020:00000080:1.0:1785787723.548554:0:12951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2c2ff68a6e841ec 00000020:00000080:1.0:1785787723.548568:0:12951:0:(genops.c:906:class_export_put()) final put ffff91907b3b7000/lustre-QMT0000_UUID 00000020:01000000:1.0:1785787723.548591:0:12951:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1785787723.548691:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff91907b3b7000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1785787723.548713:0:12951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1785787723.548751:0:12951:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1785787723.548755:0:12951:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff91905c494d40) has no exports 00000020:00000080:0.0:1785787723.549502:0:12951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2c2ff68a6e841e5 00000020:00000080:0.0:1785787723.549508:0:12951:0:(genops.c:906:class_export_put()) final put ffff91905c49c000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1785787723.549559:0:12951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1785787723.549566:0:12951:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1785787723.549568:0:12951:0:(genops.c:906:class_export_put()) final put ffff919077abe000/lustre-QMT0000_UUID 00000020:00000080:0.0:1785787723.549570:0:12951:0:(genops.c:865:class_export_destroy()) destroying export ffff919077abe000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1785787723.549575:0:12951:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1785787723.549797:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff91905c49c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1785787724.279088:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1785787724.813496:0:6642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1785787724.813503:0:6642:0:(genops.c:906:class_export_put()) final put ffff919048215800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1785787724.813611:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff919048215800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1785787724.813930:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff919048213800 for lustre-OST0000 00000001:00100000:1.0:1785787724.815159:0:5843:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f4ec65b7-e63e-42dc-becf-cba362002085 00000001:00080000:1.0:1785787724.815181:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1785787724.815185:0:5843:0:(genops.c:906:class_export_put()) final put ffff919045c79800/f4ec65b7-e63e-42dc-becf-cba362002085 00000020:00000080:2.0:1785787724.815488:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff919045c79800/f4ec65b7-e63e-42dc-becf-cba362002085 for lustre-MDT0000 00000020:00000080:2.0:1785787724.815532:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91905fadc800 for lustre-MDT0000 00010000:00010000:3.0:1785787725.300727:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1785787725.364420:0:7522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1785787725.364429:0:7522:0:(genops.c:906:class_export_put()) final put ffff91905fade000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1785787725.367759:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff91905fade000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1785787725.372601:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91905fadc000 for lustre-OST0001 00000020:01000000:0.0:1785787725.554954:0:12951:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9190507d25a0 - data ffff91906e988000/ffff918f42482000 00000020:01000000:0.0:1785787725.555078:0:12951:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff91905172fd20 - data ffff91906e82fca8/ffff919056af5c00 00000001:00000004:0.0:1785787725.560381:0:12951:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1785787725.758586:0:12951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1785787725.758593:0:12951:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1785787725.759541:0:12951:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1785787725.759545:0:12951:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1785787725.760766:0:6714:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1785787725.760771:0:6714:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:3.0:1785787725.760780:0:6714:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1785787725.761582:0:12951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1785787725.761586:0:12951:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1785787725.761602:0:12951:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1785787725.761604:0:12951:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1785787725.762197:0:7824:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1785787725.762201:0:7824:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1785787725.762209:0:7824:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1785787725.834501:0:12951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2c2ff68a6e841b4 00000020:00000080:2.0:1785787725.834512:0:12951:0:(genops.c:906:class_export_put()) final put ffff919077aa9000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1785787725.835559:0:12951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2c2ff68a6e841c9 00000020:00000080:2.0:1785787725.835565:0:12951:0:(genops.c:906:class_export_put()) final put ffff919077abf000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1785787725.835569:0:12951:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1785787725.835575:0:12951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1785787725.835582:0:12951:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1785787725.835586:0:12951:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff91904e873380) has no exports 00000004:01000000:2.0:1785787725.835718:0:12951:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1785787725.835726:0:12951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2c2ff68a6e84407 00000020:00000080:2.0:1785787725.835729:0:12951:0:(genops.c:906:class_export_put()) final put ffff919045c7e000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1785787725.835733:0:12951:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1785787725.835736:0:12951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1785787725.835742:0:12951:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1785787725.835743:0:12951:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9190515ccd40) has no exports 00000020:00000080:2.0:1785787725.835748:0:12951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2c2ff68a6e84400 00000020:00000080:2.0:1785787725.835750:0:12951:0:(genops.c:906:class_export_put()) final put ffff919045c7f000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1785787725.836068:0:12951:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1785787725.836072:0:12951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1785787725.836076:0:12951:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1785787725.836082:0:12951:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1785787725.836083:0:12951:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1785787725.836108:0:12951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1785787725.836114:0:12951:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1785787725.836118:0:12951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2c2ff68a6e84320 00000020:00000080:2.0:1785787725.836123:0:12951:0:(genops.c:906:class_export_put()) final put ffff91905fadd000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1785787725.836126:0:12951:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1785787725.836129:0:12951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1785787725.836132:0:12951:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1785787725.836135:0:12951:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff919056a78000) has no exports 00000020:00000080:2.0:1785787725.836138:0:12951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2c2ff68a6e84319 00000020:00000080:2.0:1785787725.836140:0:12951:0:(genops.c:906:class_export_put()) final put ffff91907fe68000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1785787725.836431:0:12951:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1785787725.836434:0:12951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1785787725.836443:0:12951:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1785787725.836446:0:12951:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1785787725.836447:0:12951:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1785787725.836474:0:12951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1785787725.836479:0:12951:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1785787725.836501:0:12951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1785787725.836505:0:12951:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1785787725.836527:0:12951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2c2ff68a6e841d0 00000020:00000080:2.0:1785787725.836531:0:12951:0:(genops.c:906:class_export_put()) final put ffff919077aba000/lustre-MDD0000_UUID 00000020:01000000:2.0:1785787725.836535:0:12951:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1785787725.836538:0:12951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1785787725.836541:0:12951:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1785787725.836544:0:12951:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff91904e874d40) has no exports 00000020:00000080:2.0:1785787725.836560:0:12951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1785787725.836563:0:12951:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1785787725.836566:0:12951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2c2ff68a6e841d7 00000020:00000080:2.0:1785787725.836569:0:12951:0:(genops.c:906:class_export_put()) final put ffff919077ab9000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1785787725.836574:0:12951:0:(tgt_mount.c:187:server_put_mount()) put mount ffff919056a98000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1785787725.836577:0:12951:0:(obd_mount.c:710:lustre_put_lsi()) put ffff919056a98000 3 00000020:01000004:2.0:1785787725.836581:0:12951:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff919056a98000 from lustre-MDT0000 00000020:00000080:2.0:1785787725.836595:0:12951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1785787725.836599:0:12951:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1785787725.836601:0:12951:0:(genops.c:906:class_export_put()) final put ffff919077aaa800/lustre-MDT0000_UUID 00000020:00000080:2.0:1785787725.836604:0:12951:0:(genops.c:865:class_export_destroy()) destroying export ffff919077aaa800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1785787725.836613:0:12951:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1785787725.836671:0:12951:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1785787725.836676:0:12951:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1785787725.836679:0:12951:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1785787725.836682:0:12951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1785787725.836685:0:12951:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1785787725.836692:0:12951:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9190490e8000 d8642023-9103-4dbf-85d1-f204189bc871 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1785787725.836697:0:12951:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff919056a7b380) has exports, disconnecting them 00000020:00080000:2.0:1785787725.836702:0:12951:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9190490e8000), last request at 1785787442 00000020:00000080:2.0:1785787725.836723:0:12951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2c2ff68a6e84175 00000020:00010000:2.0:1785787725.836728:0:12951:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9190490e8000: total 8 00000100:00080000:2.0:1785787725.836732:0:12951:0:(import.c:65:import_set_state_nolock()) ffff9190490e8800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1785787725.836750:0:12951:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9190490e8000): rc 0 00000020:00080000:2.0:1785787725.836754:0:12951:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff919056a7b380) has no exports 00000020:00010000:2.0:1785787725.836853:0:11050:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9190490e8000: total 8 00010000:00010000:2.0:1785787725.836881:0:11050:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9190490e8000, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1785787725.836910:0:11050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919050679c00/0xe2c2ff68a6e84485 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2c2ff68a6e8447e expref: 9 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787725.836926:0:11050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91905f902000/0xe2c2ff68a6e84477 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2c2ff68a6e84470 expref: 8 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787725.836935:0:11050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9190413a0400/0xe2c2ff68a6e844a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2c2ff68a6e8449a expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787725.836945:0:11050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9190413a1e00/0xe2c2ff68a6e84493 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2c2ff68a6e8448c expref: 6 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787725.836957:0:11050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919050679a00/0xe2c2ff68a6e846bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2c2ff68a6e846b5 expref: 5 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787725.836966:0:11050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919050679800/0xe2c2ff68a6e844cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2c2ff68a6e844c4 expref: 4 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787725.836976:0:11050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91904677de00/0xe2c2ff68a6e846ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2c2ff68a6e846c3 expref: 3 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787725.836987:0:11050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919043c0fc00/0xe2c2ff68a6e8428d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe2c2ff68a6e84286 expref: 2 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787725.836996:0:11050:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9190490e8000, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1785787725.837015:0:11050:0:(genops.c:906:class_export_put()) final put ffff9190490e8000/d8642023-9103-4dbf-85d1-f204189bc871 00010000:00010000:2.0:1785787725.837020:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787725.837022:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787725.837023:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785787725.837045:0:5813:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff919051585600:5813] 1 exiting: rc = 0 00000020:00000080:3.0:1785787725.838126:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff919077aa9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1785787725.838139:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff919077abf000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1785787725.838143:0:36:0:(genops.c:906:class_export_put()) final put ffff919077aab800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1785787725.838145:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff919077aab800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1785787725.838149:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1785787725.838250:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff919045c7e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1785787725.838255:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff919045c7f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1785787725.838259:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff919045c7d800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1785787725.838262:0:36:0:(genops.c:906:class_export_put()) final put ffff918f41bcf000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1785787725.838264:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff918f41bcf000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1785787725.838267:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1785787725.838292:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff91905fadd000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1785787725.838297:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff91907fe68000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1785787725.838301:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91907fe6e000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1785787725.838305:0:36:0:(genops.c:906:class_export_put()) final put ffff91907fe6e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1785787725.838307:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff91907fe6e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1785787725.838310:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1785787725.838355:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff919077aba000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1785787725.838365:0:36:0:(genops.c:906:class_export_put()) final put ffff919077aaf000/lustre-MDD0000_UUID 00000020:00000080:3.0:1785787725.838367:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff919077aaf000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1785787725.838370:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1785787725.838490:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff919077ab9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1785787725.838495:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9190490e8000/d8642023-9103-4dbf-85d1-f204189bc871 for MGS 00000020:00000080:3.0:1785787725.838517:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9190490e8800 for MGS 00000100:00100000:3.0:1785787725.838539:0:5814:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff91905159fa00:5814] 2 exiting: rc = 0 00000100:00100000:0.0:1785787725.838923:0:5812:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9190514bd000:5812] 0 exiting: rc = 1 00000100:00100000:2.0:1785787725.840931:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.840942:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.840947:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.840954:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.840960:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.840966:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.840972:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.840977:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.840982:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.840988:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.840994:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.840999:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841006:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841011:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841019:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841025:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841688:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841699:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841705:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841711:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841717:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841723:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841729:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841735:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841741:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841747:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841752:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841757:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841763:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841779:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841785:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841790:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841796:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841802:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841807:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841813:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841818:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841824:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841900:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841906:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841912:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841917:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841923:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841929:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841934:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841939:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841944:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841949:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841954:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841960:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841965:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841971:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841977:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841983:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841988:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841993:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.841999:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.842004:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.842009:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.842015:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.842021:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.842026:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.842084:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785787725.842093:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1785787725.842493:0:12951:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1785787725.842496:0:12951:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1785787725.846992:0:12951:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9190507d23c0 - data ffff91906eb656c0/ffff918f42480400 00000020:01000000:2.0:1785787725.847109:0:12951:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff919045e58480 - data ffff91905232a438/ffff919052681000 00000020:00000080:2.0:1785787725.847574:0:12951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2c2ff68a6e84159 00000020:00000080:2.0:1785787725.847580:0:12951:0:(genops.c:906:class_export_put()) final put ffff91904e8a5800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1785787725.847601:0:12951:0:(tgt_mount.c:187:server_put_mount()) put mount ffff919056a98000 from MGS, refs=2 00000020:01000004:2.0:1785787725.847604:0:12951:0:(obd_mount.c:710:lustre_put_lsi()) put ffff919056a98000 2 00000020:01000004:2.0:1785787725.847616:0:12951:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff919056a98000 from MGS 00000020:00000080:2.0:1785787725.847635:0:12951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1785787725.847640:0:12951:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1785787725.847643:0:12951:0:(genops.c:906:class_export_put()) final put ffff91904e8a0800/MGS 00000020:00000080:2.0:1785787725.847646:0:12951:0:(genops.c:865:class_export_destroy()) destroying export ffff91904e8a0800/MGS for MGS 00000020:01000000:2.0:1785787725.847652:0:12951:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1785787725.847698:0:12951:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1785787725.847701:0:12951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1785787725.847705:0:12951:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1785787725.847711:0:12951:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff919056aaa000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1785787725.847716:0:12951:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff9190507f19c0) has exports, disconnecting them 00000020:00080000:2.0:1785787725.847720:0:12951:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff919056aaa000), last request at 1785787444 00000020:00000080:2.0:1785787725.847724:0:12951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2c2ff68a6e84224 00000020:00080000:2.0:1785787725.847732:0:12951:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff919056aaa000): rc 0 00000020:00000080:2.0:1785787725.847736:0:12951:0:(genops.c:906:class_export_put()) final put ffff919056aaa000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1785787725.848494:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff91904e8a5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1785787725.848508:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff919056aaa000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1785787725.853885:0:12951:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1785787725.853893:0:12951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1785787725.853897:0:12951:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1785787725.853903:0:12951:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1785787725.854022:0:12951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1785787725.854040:0:12951:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1785787725.854047:0:12951:0:(obd_mount.c:710:lustre_put_lsi()) put ffff919056a98000 1 00000020:00000080:3.0:1785787725.854053:0:12951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2c2ff68a6e8414b 00000020:00000080:3.0:1785787725.854061:0:12951:0:(genops.c:906:class_export_put()) final put ffff91904e8a4000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1785787725.854066:0:12951:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1785787725.854070:0:12951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1785787725.854074:0:12951:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1785787725.854077:0:12951:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff91904e870000) has no exports 00000020:00000080:1.0:1785787725.855861:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff919056aaa800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1785787725.855870:0:37:0:(genops.c:906:class_export_put()) final put ffff919045f7e800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1785787725.855873:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff919045f7e800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1785787725.855879:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1785787725.855931:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff91904e8a4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1785787725.905247:0:12951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1785787725.905260:0:12951:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1785787725.905265:0:12951:0:(genops.c:906:class_export_put()) final put ffff91904680a800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1785787725.905269:0:12951:0:(genops.c:865:class_export_destroy()) destroying export ffff91904680a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1785787725.905279:0:12951:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1785787725.905398:0:12951:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff919056a9b800 00000020:01000000:3.0:1785787725.905417:0:12951:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1785787725.905421:0:12951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1785787725.905425:0:12951:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1785787725.905428:0:12951:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff919056a799c0) has no exports 00000100:00100000:3.0:1785787725.905507:0:9295:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff919077125e00:9295] 3 exiting: rc = 0 00000100:00100000:1.0:1785787725.907364:0:5821:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff919051584800:5821] 1 exiting: rc = 0 00000100:00100000:0.0:1785787725.909785:0:5820:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff919051585200:5820] 0 exiting: rc = 1 00000100:00100000:0.0:1785787725.909965:0:5822:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff919052643c00:5822] 2 exiting: rc = 0 00000100:00100000:3.0:1785787725.912747:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.912757:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.912763:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.912768:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.912774:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.912781:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.912788:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.912792:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.912798:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.912804:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.912809:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.912815:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.912820:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.912846:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.912852:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.912858:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.912863:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.912881:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.912888:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.912894:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.912900:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.912906:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.912912:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.912917:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.912923:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.912929:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.912934:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.912940:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.912945:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.912951:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.912956:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.912961:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.912967:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.912972:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.912978:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.912995:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.913000:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.913006:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.913011:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.913016:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.913021:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.913027:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.913112:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.913120:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.913126:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.913131:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.913136:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.913142:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.913147:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.913152:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.913158:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.913162:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.913176:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.913182:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.913187:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.913193:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.913198:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.913204:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.913210:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.913215:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.913220:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.913225:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.913230:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.913242:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.920500:0:5823:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff919052643800:5823] 0 exiting: rc = 1 00000100:00100000:2.0:1785787725.920769:0:5824:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff91906e4fee00:5824] 1 exiting: rc = 0 00000100:00100000:3.0:1785787725.933802:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.933812:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.933819:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.933824:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.933855:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.933861:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.933878:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.933884:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.933889:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.933895:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.933900:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.933905:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.933912:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.933917:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.933922:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.933927:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.933932:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.933937:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.933942:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.933946:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.933951:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.933957:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.933962:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.933966:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.933971:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.933976:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.933981:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.933985:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.933990:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.933995:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.934000:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.934005:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.934010:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.934016:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.934021:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.934025:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.934030:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.934946:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.934953:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.934958:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.934964:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.934976:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.934981:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.934988:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.934993:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.934999:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.935005:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.935010:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.935016:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.935020:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.935026:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.935040:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.935046:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.935051:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.935056:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.935061:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.935066:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.935071:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.935076:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.935081:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.935086:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.935090:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.935095:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.935100:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.935741:0:5826:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff91905267b400:5826] 1 exiting: rc = 0 00000100:00100000:1.0:1785787725.935854:0:5825:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff919054317600:5825] 0 exiting: rc = 1 00000100:00100000:3.0:1785787725.937230:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937238:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937244:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937250:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937255:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937261:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937266:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937271:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937276:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937281:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937287:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937292:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937319:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937325:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937330:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937336:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937341:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937346:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937351:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937355:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937361:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937367:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937372:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937378:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937401:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937408:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937413:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937419:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937427:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937432:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937438:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937444:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937450:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937455:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937461:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937467:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937487:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937493:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937499:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937505:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937511:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937516:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937522:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937527:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937533:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937539:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937545:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937558:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937576:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937583:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937589:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937594:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937600:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937621:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937628:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937635:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937640:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937646:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937651:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937656:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937676:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937683:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937688:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.937693:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952554:0:5827:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff919045df6600:5827] 0 exiting: rc = 1 00000100:00100000:1.0:1785787725.952641:0:5828:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff919045df7200:5828] 1 exiting: rc = 0 00000100:00100000:1.0:1785787725.952693:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952700:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952705:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952710:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952715:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952720:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952725:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952730:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952734:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952739:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952743:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952748:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952753:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952757:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952762:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952766:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952770:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952774:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952778:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952783:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952787:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952792:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952796:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952800:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952804:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952808:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952813:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952817:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952821:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952842:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952847:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952860:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952866:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952882:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952887:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952892:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952897:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952903:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952907:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952912:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952917:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952922:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952927:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952932:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952937:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952942:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952946:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952950:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952955:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952960:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952965:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952969:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952974:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952979:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952984:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952988:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952992:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.952997:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.953002:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.953007:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.953011:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.953016:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.953020:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.953026:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.953276:0:5829:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff919048c56a00:5829] 0 exiting: rc = 1 00000100:00100000:0.0:1785787725.955150:0:5830:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff919045df7e00:5830] 1 exiting: rc = 0 00000100:00100000:1.0:1785787725.958813:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.958821:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.958849:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.958869:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.958874:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.958879:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.958885:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.958891:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.958896:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.958901:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.958906:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.958911:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.958916:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.958922:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.958927:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.958932:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.958937:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.958942:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.958947:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.958952:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.958957:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.958962:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.958967:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.958973:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.958978:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.958983:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.958988:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.958993:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.958998:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.959003:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.959008:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.959013:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.959018:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.959023:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.959028:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.959116:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.959124:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.959129:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.959141:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.959146:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.959151:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.959156:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.959161:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.959173:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.959179:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.959184:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.959189:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.959194:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.959199:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.959204:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.959208:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.959213:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.959218:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.959223:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.959228:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.959233:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.959238:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.959243:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.959248:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.959253:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.959258:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.959262:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.959267:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.959272:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.972015:0:5832:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff91905269b800:5832] 1 exiting: rc = 0 00000100:00100000:3.0:1785787725.972147:0:5831:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff91905269b400:5831] 0 exiting: rc = 1 00000100:00100000:1.0:1785787725.972765:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.972773:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.972780:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.972787:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.972794:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.972800:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.972807:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.972814:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.972870:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.972877:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.972884:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.972891:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.972898:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.972905:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.972912:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.972918:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.972926:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.972932:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.972938:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.972944:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.972948:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.972953:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.972958:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.972963:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.972968:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.972973:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.972978:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.972985:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.972992:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.972996:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.973001:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.973006:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.973010:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.973014:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.973018:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.973023:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.973027:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.973121:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.973130:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.973135:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.973140:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.973146:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.973151:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.973163:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.973177:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.973183:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.973188:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.973193:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.973198:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.973203:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.973207:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.973213:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.973218:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.973222:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.973226:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.973231:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.973235:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.973240:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.973245:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.973250:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.973254:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.973259:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.973264:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.973269:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785787725.976336:0:5833:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff91905269a200:5833] 0 exiting: rc = 1 00000100:00100000:1.0:1785787725.978895:0:5834:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff91905269aa00:5834] 1 exiting: rc = 0 00000100:00100000:1.0:1785787725.979068:0:5835:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff91905269ac00:5835] 2 exiting: rc = 0 00000100:00100000:1.0:1785787725.979127:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979148:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979155:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979160:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979172:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979178:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979184:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979190:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979196:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979201:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979207:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979212:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979231:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979237:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979242:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979247:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979253:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979258:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979264:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979269:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979274:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979279:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979284:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979289:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979294:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979311:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979317:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979322:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979328:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979334:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979339:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979344:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979349:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979354:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979359:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979365:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979370:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979375:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979380:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979385:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979391:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979396:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979401:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979407:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979412:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979418:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979424:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979435:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979441:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979459:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979466:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979471:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979476:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979482:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979487:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979492:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979497:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979502:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979508:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979513:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979519:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979524:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979529:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787725.979535:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1785787725.986916:0:12951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1785787725.986927:0:12951:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1785787725.986933:0:12951:0:(genops.c:906:class_export_put()) final put ffff919044e85800/MDS_uuid 00000020:00000080:1.0:1785787725.986937:0:12951:0:(genops.c:865:class_export_destroy()) destroying export ffff919044e85800/MDS_uuid for MDS 00000020:01000000:1.0:1785787725.986947:0:12951:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1785787725.987068:0:12951:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1785787726.323868:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787726.773150:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3334:1872533770041984:0@lo:400:kworker.0 00000400:00000100:0.0:1785787726.773211:0:3334:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1872533770041984 offset 0 length 224: 4 00000100:00100000:0.0:1785787726.773261:0:3334:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785787726.773268:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533770041856:0@lo:400:kworker.0 00000400:00000100:0.0:1785787726.773287:0:3334:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1872533770041856 offset 0 length 224: 4 00000100:00100000:2.0:1785787726.773441:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3335:1872533770042112:0@lo:400:kworker.0 00000400:00000100:2.0:1785787726.773466:0:3335:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1872533770042112 offset 0 length 224: 4 00010000:00010000:1.0:1785787727.347242:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787728.376942:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787729.394985:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1785787729.906078:0:13104:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1785787729.925938:0:13104:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1785787729.925982:0:13104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff9190413a0600/0xe2c2ff68a6e8448c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84493 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787729.926011:0:13104:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff9190413a0600/0xe2c2ff68a6e8448c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e84493 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787729.926018:0:13104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff9190413a0600/0xe2c2ff68a6e8448c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2c2ff68a6e84493 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787729.926025:0:13104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.153@tcp lock: ffff9190413a0600/0xe2c2ff68a6e8448c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2c2ff68a6e84493 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787729.926044:0:13104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1785787729.926049:0:13104:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1785787729.926075:0:13104:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1785787729.926086:0:13104:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91907764d880 x1872533770041984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787742 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787729.926103:0:13104:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00100000:2.0:1785787729.926130:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3334:1872533770041984:0@lo:400:kworker.0 00000100:00080000:2.0:1785787729.926167:0:13104:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1785787729.926189:0:13104:0:(import.c:65:import_set_state_nolock()) ffff91907fe69800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1785787729.927823:0:3332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1872533770042240:0@lo:39:umount.0 00000400:00000100:2.0:1785787729.927883:0:3332:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1872533770042240 offset 0 length 224: 4 00010000:00010000:3.0:1785787729.927990:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785787729.927997:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff9190413a0600/0xe2c2ff68a6e8448c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2c2ff68a6e84493 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787729.928006:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413a0600 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:3.0:1785787729.928009:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff9190413a0600/0xe2c2ff68a6e8448c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2c2ff68a6e84493 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787729.928018:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff9190413a0600/0xe2c2ff68a6e8448c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2c2ff68a6e84493 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785787729.928025:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff9190413a0600/0xe2c2ff68a6e8448c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2c2ff68a6e84493 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785787729.928045:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1785787729.928047:0:5808:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1785787729.928050:0:5808:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1785787729.928076:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff9190413a0600/0xe2c2ff68a6e8448c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2c2ff68a6e84493 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787729.928082:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785787729.928107:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff9190413a0600/0xe2c2ff68a6e8448c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2c2ff68a6e84493 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787729.928123:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff9190413a0600/0xe2c2ff68a6e8448c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xe2c2ff68a6e84493 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787729.928136:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787729.928146:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787729.928147:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787729.928156:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785787729.928165:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076d8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8642023-9103-4dbf-85d1-f204189bc871:3335:1872533770042368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785787729.928199:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787729.928245:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770042368 00000100:00100000:3.0:1785787729.928251:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770042368 00000100:00100000:3.0:1785787729.928290:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1785787729.928296:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076d88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3335:x1872533770042368:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1785787729.928302:0:5805:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785787729 with bad export cookie 16339903222995501429 00000100:00100000:3.0:1785787729.942718:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076d88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3335:x1872533770042368:12345-0@lo:103:ldlm_bl.0 Request processed in 14413us (14510us total) trans 0 rc -107/-107 00000100:00100000:3.0:1785787729.942731:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1785787729.944433:0:3335:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.153@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1785787729.944439:0:3335:0:(import.c:65:import_set_state_nolock()) ffff91904e8a3800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1785787729.944443:0:3335:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.153@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1785787729.958594:0:3335:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.153@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1785787729.958599:0:3335:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1785787729.958622:0:3335:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91907764ea00 x1872533770041856/t0(0) o400->MGC192.168.203.153@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1785787742 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787729.958641:0:3335:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff919076d8b800 x1872533770042368/t0(0) o103->MGC192.168.203.153@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1785787745 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1785787729.958650:0:3335:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1785787729.958653:0:3335:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1785787729.958654:0:3335:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1785787729.958658:0:3335:0:(import.c:65:import_set_state_nolock()) ffff91904e8a3800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1785787729.958662:0:3335:0:(import.c:510:import_select_connection()) MGC192.168.203.153@tcp: connect to NID 0@lo last attempt 229 00000100:00080000:2.0:1785787729.958670:0:3335:0:(import.c:624:import_select_connection()) MGC192.168.203.153@tcp: import ffff91904e8a3800 using connection 192.168.203.153@tcp/0@lo 00000100:00100000:2.0:1785787729.958774:0:3335:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91907764f800 x1872533770042496/t0(0) o250->MGC192.168.203.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1785787729.958804:0:3332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d8642023-9103-4dbf-85d1-f204189bc871:3332:1872533770042496:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:2.0:1785787729.958877:0:3332:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1872533770042496 offset 0 length 520: 4 00000100:00100000:2.0:1785787729.958930:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076d8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8642023-9103-4dbf-85d1-f204189bc871:3335:1872533770042368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785787729.961527:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8642023-9103-4dbf-85d1-f204189bc871:3334:1872533770041856:0@lo:400:kworker.0 00010000:00010000:1.0:1785787730.419928:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787731.446857:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1785787731.892804:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) d8642023-9103-4dbf-85d1-f204189bc871->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1785787731.892845:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) d8642023-9103-4dbf-85d1-f204189bc871->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1785787731.892977:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076d8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3333:1872533770042624:0@lo:400:kworker.0 00000400:00000100:1.0:1785787731.893036:0:3333:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1872533770042624 offset 0 length 224: 4 00010000:00010000:3.0:1785787732.472765:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787733.491110:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787734.515218:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1785787734.899062:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) d8642023-9103-4dbf-85d1-f204189bc871->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1785787734.899075:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) d8642023-9103-4dbf-85d1-f204189bc871->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1785787734.899193:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41390e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3334:1872533770042752:0@lo:400:kworker.0 00000400:00000100:2.0:1785787734.899249:0:3334:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1872533770042752 offset 0 length 224: 4 00010000:00010000:3.0:1785787735.545280:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787736.563107:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787737.590341:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787738.611249:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787739.060267:0:3332:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1785787729/real 1785787729] req@ffff91907764f800 x1872533770042496/t0(0) o250->MGC192.168.203.153@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1785787739 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787739.060332:0:3332:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91907764f800 x1872533770042496/t0(0) o250->MGC192.168.203.153@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1785787739 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787739.060345:0:3332:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1785787729/real 1785787729] req@ffff91907764d880 x1872533770042240/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1785787739 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787739.060357:0:3332:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91907764d880 x1872533770042240/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1785787739 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1785787739.060372:0:3332:0:(import.c:65:import_set_state_nolock()) ffff91904e8a3800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1785787739.060394:0:3332:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1785787739.060399:0:3332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d8642023-9103-4dbf-85d1-f204189bc871:3332:1872533770042496:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:0.0:1785787739.060405:0:3332:0:(import.c:65:import_set_state_nolock()) ffff91907fe69800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1785787739.060419:0:3332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1872533770042240:0@lo:39:umount.0 00000100:00080000:2.0:1785787739.060567:0:13104:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1785787739.060572:0:13104:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1785787739.060578:0:13104:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1785787739.062550:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) d8642023-9103-4dbf-85d1-f204189bc871->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1785787739.062558:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1785787739.062562:0:37:0:(import.c:65:import_set_state_nolock()) ffff91904e8a3800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1785787739.062570:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.153@tcp: connect to NID 0@lo last attempt 517 00000100:00080000:3.0:1785787739.062576:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.153@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1785787739.062584:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.153@tcp: import ffff91904e8a3800 using connection 192.168.203.153@tcp/0@lo 00000100:00100000:3.0:1785787739.062620:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff919076d88e00 x1872533770042880/t0(0) o250->MGC192.168.203.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785787739.062724:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785787739.062740:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3336:1872533770043008:0@lo:400:kworker.0 00000400:00000100:3.0:1785787739.062798:0:3336:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1872533770043008 offset 0 length 224: 4 00010000:00010000:2.0:1785787739.063775:0:13104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff919050679400/0xe2c2ff68a6e8449a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e844a1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787739.063791:0:13104:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff919050679400/0xe2c2ff68a6e8449a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e844a1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787739.063798:0:13104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff919050679400/0xe2c2ff68a6e8449a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2c2ff68a6e844a1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787739.063819:0:13104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.153@tcp lock: ffff919050679400/0xe2c2ff68a6e8449a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2c2ff68a6e844a1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787739.063858:0:13104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785787739.063867:0:13104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff919043c0e600/0xe2c2ff68a6e846c3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e846ca expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787739.063873:0:13104:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff919043c0e600/0xe2c2ff68a6e846c3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e846ca expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787739.063879:0:13104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff919043c0e600/0xe2c2ff68a6e846c3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2c2ff68a6e846ca expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787739.063885:0:13104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.153@tcp lock: ffff919043c0e600/0xe2c2ff68a6e846c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2c2ff68a6e846ca expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787739.063905:0:13104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1785787739.063910:0:13104:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1785787739.063954:0:13104:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1785787739.063959:0:13104:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1785787739.063965:0:13104:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00010000:00010000:1.0:1785787739.064104:0:11050:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1785787739.064113:0:11050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff919050679400/0xe2c2ff68a6e8449a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2c2ff68a6e844a1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787739.064122:0:11050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919050679400 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:1.0:1785787739.064126:0:11050:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff919050679400/0xe2c2ff68a6e8449a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2c2ff68a6e844a1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787739.064137:0:11050:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff919050679400/0xe2c2ff68a6e8449a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2c2ff68a6e844a1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785787739.064153:0:11050:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff919050679400/0xe2c2ff68a6e8449a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2c2ff68a6e844a1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785787739.064159:0:11050:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1785787739.064162:0:11050:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1785787739.064164:0:11050:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1785787739.064179:0:11050:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91904e8a3800 00010000:00010000:1.0:1785787739.064183:0:11050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff919050679400/0xe2c2ff68a6e8449a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xe2c2ff68a6e844a1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787739.064189:0:11050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff919050679400/0xe2c2ff68a6e8449a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xe2c2ff68a6e844a1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787739.064207:0:11050:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785787739.064219:0:11050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff919043c0e600/0xe2c2ff68a6e846c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2c2ff68a6e846ca expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787739.064237:0:11050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0e600 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:1.0:1785787739.064240:0:11050:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff919043c0e600/0xe2c2ff68a6e846c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2c2ff68a6e846ca expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787739.064247:0:11050:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff919043c0e600/0xe2c2ff68a6e846c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2c2ff68a6e846ca expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785787739.064253:0:11050:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff919043c0e600/0xe2c2ff68a6e846c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2c2ff68a6e846ca expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785787739.064259:0:11050:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1785787739.064261:0:11050:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1785787739.064263:0:11050:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1785787739.064271:0:11050:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91904e8a3800 00010000:00010000:1.0:1785787739.064274:0:11050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff919043c0e600/0xe2c2ff68a6e846c3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe2c2ff68a6e846ca expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787739.064281:0:11050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff919043c0e600/0xe2c2ff68a6e846c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe2c2ff68a6e846ca expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787739.064291:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787739.064294:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787739.064295:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787739.064730:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1785787739.064762:0:13104:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1785787739.064767:0:13104:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9190507f0000) has no exports 00000020:00080000:2.0:1785787739.064799:0:13104:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9190507f0000) has no exports 00000100:00100000:0.0:1785787739.065057:0:3332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076d88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d8642023-9103-4dbf-85d1-f204189bc871:3332:1872533770042880:0@lo:250:kworker.0 00000400:00000100:0.0:1785787739.065101:0:3332:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1872533770042880 offset 0 length 520: 4 00000020:01000000:2.0:1785787739.077870:0:13104:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9190776d6c00 - data ffff91906eb27af8/ffff9190776e5800 00000020:01000000:2.0:1785787739.078067:0:13104:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff919046814cc0 - data ffff919078ba9870/ffff91905f936800 00100000:10000000:2.0:1785787739.112305:0:13104:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1785787739.159354:0:13104:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2c2ff68a6e842a9 00000020:00000080:3.0:1785787739.159368:0:13104:0:(genops.c:906:class_export_put()) final put ffff91907feb2000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1785787739.159397:0:13104:0:(tgt_mount.c:187:server_put_mount()) put mount ffff919048214000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1785787739.159402:0:13104:0:(obd_mount.c:710:lustre_put_lsi()) put ffff919048214000 2 00000020:01000004:3.0:1785787739.159406:0:13104:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff919048214000 from lustre-OST0000 00000020:00000080:3.0:1785787739.159437:0:13104:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1785787739.159448:0:13104:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1785787739.159451:0:13104:0:(genops.c:906:class_export_put()) final put ffff91907feb0000/lustre-OST0000_UUID 00000020:00000080:3.0:1785787739.159454:0:13104:0:(genops.c:865:class_export_destroy()) destroying export ffff91907feb0000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1785787739.159462:0:13104:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1785787739.159510:0:13104:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1785787739.159515:0:13104:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1785787739.159531:0:13104:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1785787739.159537:0:13104:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1785787739.159545:0:13104:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff91907fe69000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1785787739.159552:0:13104:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff919056a7cd40) has exports, disconnecting them 00000020:00080000:3.0:1785787739.159558:0:13104:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff91907fe69000), last request at 1785787465 00000020:00000080:3.0:1785787739.159562:0:13104:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2c2ff68a6e842d3 00000020:00080000:3.0:1785787739.159572:0:13104:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff91907fe69000): rc 0 00000020:00000080:3.0:1785787739.159578:0:13104:0:(genops.c:906:class_export_put()) final put ffff91907fe69000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1785787739.159763:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff91907feb2000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1785787739.159774:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff91907fe69000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1785787739.241908:0:13104:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1785787739.241921:0:13104:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1785787739.241927:0:13104:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1785787739.241950:0:13104:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1785787739.242036:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91907fe69800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1785787739.242165:0:13104:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1785787739.242177:0:13104:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1785787739.242183:0:13104:0:(genops.c:906:class_export_put()) final put ffff91907fe6c000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1785787739.242188:0:13104:0:(genops.c:865:class_export_destroy()) destroying export ffff91907fe6c000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1785787739.242202:0:13104:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1785787739.242275:0:13104:0:(obd_mount.c:710:lustre_put_lsi()) put ffff919048214000 1 00000020:00000080:1.0:1785787739.242282:0:13104:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2c2ff68a6e84263 00000020:00000080:1.0:1785787739.242290:0:13104:0:(genops.c:906:class_export_put()) final put ffff919077aac800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1785787739.242306:0:13104:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1785787739.242312:0:13104:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1785787739.242316:0:13104:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1785787739.242321:0:13104:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9190507f4d40) has no exports 00000020:00000080:2.0:1785787739.242468:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff919077aac800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1785787739.324873:0:13104:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1785787739.324893:0:13104:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1785787739.324900:0:13104:0:(genops.c:906:class_export_put()) final put ffff919056aae000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1785787739.324906:0:13104:0:(genops.c:865:class_export_destroy()) destroying export ffff919056aae000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1785787739.324913:0:13104:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1785787739.325089:0:13104:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff919045f78800 00000020:02000400:1.0:1785787739.325152:0:13104:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1785787739.636099:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787740.673531:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787741.683766:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1785787742.131996:0:3335:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1785787726/real 1785787726] req@ffff91907764d180 x1872533770042112/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1785787742 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787742.156674:0:3335:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff91907764d180 x1872533770042112/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1785787742 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1785787742.156693:0:3335:0:(import.c:65:import_set_state_nolock()) ffff918f41bcd800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1785787742.156698:0:3335:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1785787742.163569:0:3335:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00080000:3.0:1785787742.163687:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) d8642023-9103-4dbf-85d1-f204189bc871->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1785787742.163694:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) d8642023-9103-4dbf-85d1-f204189bc871->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1785787742.163697:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1785787742.163700:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1785787742.163704:0:36:0:(import.c:65:import_set_state_nolock()) ffff918f41bcd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1785787742.163714:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 276 00000100:00080000:3.0:1785787742.163725:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff918f41bcd800 using connection 192.168.203.153@tcp/0@lo 00000100:00100000:3.0:1785787742.163771:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff919076d8b100 x1872533770043136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785787742.163962:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3335:1872533770042112:0@lo:400:kworker.0 00000100:00100000:2.0:1785787742.164139:0:3332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076d8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1872533770043136:0@lo:38:kworker.0 00000400:00000100:2.0:1785787742.164203:0:3332:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1872533770043136 offset 0 length 520: 4 00000020:01000004:0.0:1785787742.573773:0:13255:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1785787742.603576:0:13255:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1785787742.603660:0:13255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff919050678400/0xe2c2ff68a6e84470 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84477 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787742.603677:0:13255:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff919050678400/0xe2c2ff68a6e84470 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e84477 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787742.603685:0:13255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff919050678400/0xe2c2ff68a6e84470 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2c2ff68a6e84477 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787742.603713:0:13255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.153@tcp lock: ffff919050678400/0xe2c2ff68a6e84470 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2c2ff68a6e84477 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787742.603742:0:13255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1785787742.603748:0:13255:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1785787742.603775:0:13255:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1785787742.603790:0:13255:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff919076d8a680 x1872533770042624/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787747 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787742.603813:0:13255:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff918f41390e00 x1872533770042752/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787750 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787742.603845:0:13255:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff919076d8a300 x1872533770043008/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787755 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787742.603859:0:13255:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff919076d8b100 x1872533770043136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1785787752 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787742.603869:0:13255:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1785787742.603875:0:13255:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1785787742.603882:0:13255:0:(import.c:65:import_set_state_nolock()) ffff918f41bcd800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1785787742.603886:0:13255:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1785787742.603890:0:13255:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff919076d8a680 x1872533770042624/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787747 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787742.603898:0:13255:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff918f41390e00 x1872533770042752/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787750 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787742.603906:0:13255:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff919076d8a300 x1872533770043008/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787755 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787742.603912:0:13255:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff919076d8b100 x1872533770043136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1785787752 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787742.603929:0:13255:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1785787742.603933:0:13255:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:3.0:1785787742.604024:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3336:1872533770043008:0@lo:400:kworker.0 00010000:00010000:1.0:1785787742.604212:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785787742.604221:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff919050678400/0xe2c2ff68a6e84470 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2c2ff68a6e84477 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787742.604229:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919050678400 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:1.0:1785787742.604233:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff919050678400/0xe2c2ff68a6e84470 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2c2ff68a6e84477 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787742.604243:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff919050678400/0xe2c2ff68a6e84470 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2c2ff68a6e84477 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785787742.604262:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff919050678400/0xe2c2ff68a6e84470 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2c2ff68a6e84477 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785787742.604269:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1785787742.604272:0:5808:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1785787742.604274:0:5808:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1785787742.604298:0:5808:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91904e8a3800 00010000:00010000:1.0:1785787742.604303:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff919050678400/0xe2c2ff68a6e84470 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe2c2ff68a6e84477 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787742.604310:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff919050678400/0xe2c2ff68a6e84470 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe2c2ff68a6e84477 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787742.604323:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787742.604325:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787742.604327:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785787742.604469:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076d8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3333:1872533770042624:0@lo:400:kworker.0 00000100:00100000:2.0:1785787742.604507:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41390e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3334:1872533770042752:0@lo:400:kworker.0 00000100:00100000:2.0:1785787742.604538:0:3332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076d8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1872533770043136:0@lo:38:kworker.0 00010000:00010000:0.0:1785787742.606644:0:13255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff91905f902400/0xe2c2ff68a6e8447e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e84485 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787742.606662:0:13255:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff91905f902400/0xe2c2ff68a6e8447e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e84485 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787742.606670:0:13255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff91905f902400/0xe2c2ff68a6e8447e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2c2ff68a6e84485 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787742.606677:0:13255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.153@tcp lock: ffff91905f902400/0xe2c2ff68a6e8447e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2c2ff68a6e84485 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787742.606734:0:13255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785787742.606742:0:13255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff91905f902c00/0xe2c2ff68a6e846b5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e846bc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787742.606749:0:13255:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff91905f902c00/0xe2c2ff68a6e846b5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e846bc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787742.606756:0:13255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff91905f902c00/0xe2c2ff68a6e846b5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2c2ff68a6e846bc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787742.606763:0:13255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.153@tcp lock: ffff91905f902c00/0xe2c2ff68a6e846b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe2c2ff68a6e846bc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787742.609416:0:11050:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1785787742.609429:0:11050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff91905f902400/0xe2c2ff68a6e8447e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2c2ff68a6e84485 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787742.609441:0:11050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f902400 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:1.0:1785787742.609446:0:11050:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff91905f902400/0xe2c2ff68a6e8447e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2c2ff68a6e84485 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787742.609457:0:11050:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff91905f902400/0xe2c2ff68a6e8447e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2c2ff68a6e84485 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785787742.609465:0:11050:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff91905f902400/0xe2c2ff68a6e8447e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2c2ff68a6e84485 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785787742.609496:0:11050:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1785787742.609499:0:11050:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1785787742.609515:0:11050:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91904e8a3800 00010000:00010000:1.0:1785787742.609519:0:11050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff91905f902400/0xe2c2ff68a6e8447e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe2c2ff68a6e84485 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787742.609527:0:11050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff91905f902400/0xe2c2ff68a6e8447e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe2c2ff68a6e84485 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787742.609544:0:11050:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785787742.609548:0:11050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff91905f902c00/0xe2c2ff68a6e846b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2c2ff68a6e846bc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787742.609554:0:11050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f902c00 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:1.0:1785787742.609557:0:11050:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff91905f902c00/0xe2c2ff68a6e846b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe2c2ff68a6e846bc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787742.609564:0:11050:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff91905f902c00/0xe2c2ff68a6e846b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2c2ff68a6e846bc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785787742.609571:0:11050:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff91905f902c00/0xe2c2ff68a6e846b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2c2ff68a6e846bc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785787742.609576:0:11050:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1785787742.609578:0:11050:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1785787742.609582:0:11050:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91904e8a3800 00010000:00010000:1.0:1785787742.609585:0:11050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff91905f902c00/0xe2c2ff68a6e846b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xe2c2ff68a6e846bc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787742.609603:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787742.609605:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787742.609607:0:11050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787742.609711:0:13255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1785787742.609718:0:13255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff91905f902c00/0xe2c2ff68a6e846b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xe2c2ff68a6e846bc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785787742.609740:0:13255:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1785787742.609745:0:13255:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1785787742.609748:0:13255:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1785787742.609778:0:13255:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1785787742.609783:0:13255:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1785787742.609789:0:13255:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1785787742.609795:0:13255:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1785787742.609799:0:13255:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9190507f3380) has no exports 00000020:00080000:0.0:1785787742.609855:0:13255:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9190507f3380) has no exports 00010000:00010000:3.0:1785787742.613364:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1785787742.615039:0:13255:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9190776d6ae0 - data ffff91906eb276c0/ffff91907bd82400 00000020:01000000:0.0:1785787742.615228:0:13255:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff91905064d3c0 - data ffff91906ea6d6c0/ffff91907bdb5000 00100000:10000000:2.0:1785787742.634550:0:13255:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1785787742.696938:0:13255:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2c2ff68a6e84374 00000020:00000080:3.0:1785787742.696948:0:13255:0:(genops.c:906:class_export_put()) final put ffff919077065000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1785787742.697012:0:13255:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91907fddf800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1785787742.697018:0:13255:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91907fddf800 2 00000020:01000004:3.0:1785787742.697021:0:13255:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91907fddf800 from lustre-OST0001 00000020:00000080:3.0:1785787742.697062:0:13255:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1785787742.697072:0:13255:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1785787742.697115:0:13255:0:(genops.c:906:class_export_put()) final put ffff91907feb1800/lustre-OST0001_UUID 00000020:00000080:3.0:1785787742.697118:0:13255:0:(genops.c:865:class_export_destroy()) destroying export ffff91907feb1800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1785787742.697124:0:13255:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1785787742.697243:0:13255:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import d8642023-9103-4dbf-85d1-f204189bc871->MGS 00010000:00010000:3.0:1785787742.697309:0:13255:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff919043c0f000/0xe2c2ff68a6e84286 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2c2ff68a6e8428d expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785787742.697321:0:13255:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff919043c0f000/0xe2c2ff68a6e84286 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2c2ff68a6e8428d expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785787742.697326:0:13255:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1785787742.697328:0:13255:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1785787742.697332:0:13255:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1785787742.697345:0:13255:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91904e8a3800 00010000:00010000:3.0:1785787742.697349:0:13255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff919043c0f000/0xe2c2ff68a6e84286 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe2c2ff68a6e8428d expref: -99 pid: 6613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787742.697362:0:13255:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff9190413a0e00/0xe2c2ff68a6e844c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe2c2ff68a6e844cb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785787742.697368:0:13255:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff9190413a0e00/0xe2c2ff68a6e844c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe2c2ff68a6e844cb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785787742.697373:0:13255:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1785787742.697375:0:13255:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1785787742.697377:0:13255:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1785787742.697385:0:13255:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91904e8a3800 00010000:00010000:3.0:1785787742.697388:0:13255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff9190413a0e00/0xe2c2ff68a6e844c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe2c2ff68a6e844cb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1785787742.697415:0:13255:0:(import.c:65:import_set_state_nolock()) ffff91904e8a3800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1785787742.697419:0:13255:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1785787742.697421:0:13255:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1785787742.697422:0:13255:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1785787742.697425:0:13255:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1785787742.697436:0:13255:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff919076d88e00 x1872533770042880/t0(0) o250->MGC192.168.203.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1785787754 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1785787742.697452:0:13255:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1785787742.697454:0:13255:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:1.0:1785787742.697567:0:3332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076d88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d8642023-9103-4dbf-85d1-f204189bc871:3332:1872533770042880:0@lo:250:kworker.0 10000000:01000000:3.0:1785787742.698885:0:13255:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1785787742.698893:0:13255:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2c2ff68a6e84167 00000020:00000080:3.0:1785787742.698897:0:13255:0:(genops.c:906:class_export_put()) final put ffff919044e87000/d8642023-9103-4dbf-85d1-f204189bc871 00000020:00000080:0.0:1785787742.699888:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff919077065000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1785787742.701205:0:13255:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.153@tcp (flags='') 00000020:00000080:3.0:1785787742.701211:0:13255:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1785787742.701217:0:13255:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.153@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1785787742.701221:0:13255:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9190515cb380) has no exports 10000000:01000000:1.0:1785787742.701277:0:5818:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1785787742.702897:0:13255:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.153@tcp: client import never connected 00000100:00080000:3.0:1785787742.702902:0:13255:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1785787742.702905:0:13255:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1785787742.702908:0:13255:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1785787742.702910:0:13255:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1785787742.703034:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff919044e87000/d8642023-9103-4dbf-85d1-f204189bc871 for MGC192.168.203.153@tcp 00000020:00000080:3.0:1785787742.705980:0:13255:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1785787742.705991:0:13255:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.153@tcp (uuid d8642023-9103-4dbf-85d1-f204189bc871) 00000020:01000000:3.0:1785787742.705998:0:13255:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1785787742.706003:0:13255:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1785787742.706007:0:13255:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1785787742.706014:0:13255:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff918f41bcb800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1785787742.706019:0:13255:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff9190515c99c0) has exports, disconnecting them 00000020:00080000:3.0:1785787742.706023:0:13255:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff918f41bcb800), last request at 1785787489 00000020:00000080:3.0:1785787742.706027:0:13255:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2c2ff68a6e8439e 00000020:00080000:3.0:1785787742.706064:0:13255:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff918f41bcb800): rc 0 00000020:00000080:3.0:1785787742.706069:0:13255:0:(genops.c:906:class_export_put()) final put ffff918f41bcb800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1785787742.707017:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91904e8a3800 for MGC192.168.203.153@tcp 00000020:00000080:1.0:1785787742.707025:0:37:0:(genops.c:906:class_export_put()) final put ffff919045f7c800/d8642023-9103-4dbf-85d1-f204189bc871 00000020:00000080:1.0:1785787742.707028:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff919045f7c800/d8642023-9103-4dbf-85d1-f204189bc871 for MGC192.168.203.153@tcp 00000020:01000000:1.0:1785787742.707039:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.153@tcp (d8642023-9103-4dbf-85d1-f204189bc871) 00000020:00000080:1.0:1785787742.709986:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff918f41bcb800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1785787742.750136:0:13255:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1785787742.750145:0:13255:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1785787742.750149:0:13255:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1785787742.750156:0:13255:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1785787742.750246:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:1.0:1785787742.750356:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff918f41bcd800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1785787742.750433:0:11050:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1785787742.750552:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1785787742.750725:0:5803:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff919045f32000:5803] 0 exiting: rc = 1 00000100:00100000:1.0:1785787742.750773:0:5804:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff919044da0600:5804] 1 exiting: rc = 0 00000100:00100000:0.0:1785787742.750881:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.751224:0:5807:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff919055737600:5807] 2 exiting: rc = 0 00000100:00100000:1.0:1785787742.751301:0:11051:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff919056b42400:11051] 3 exiting: rc = 0 00000100:00100000:0.0:1785787742.754988:0:5806:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff919080949000:5806] 1 exiting: rc = 0 00000100:00100000:0.0:1785787742.760100:0:5805:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9190559b8c00:5805] 0 exiting: rc = 1 00000100:00100000:1.0:1785787742.760228:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760239:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760245:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760251:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760256:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760261:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760267:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760272:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760278:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760283:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760305:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760311:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760317:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760323:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760328:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760334:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760340:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760345:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760350:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760354:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760359:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760365:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760369:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760373:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760378:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760383:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760387:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760392:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760397:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760401:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760406:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760410:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760415:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760420:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760424:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760428:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760433:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760438:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760442:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760447:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760451:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760455:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760460:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760466:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760471:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760484:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760489:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760494:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760499:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760504:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760509:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760514:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760518:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760523:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760527:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760532:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760536:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760540:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760544:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760549:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760553:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760557:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760561:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.760566:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1785787742.761198:0:13255:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1785787742.761206:0:13255:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1785787742.761212:0:13255:0:(genops.c:906:class_export_put()) final put ffff91907fddc000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1785787742.761216:0:13255:0:(genops.c:865:class_export_destroy()) destroying export ffff91907fddc000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1785787742.761221:0:13255:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1785787742.761257:0:13255:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91907fddf800 1 00000020:00000080:1.0:1785787742.761263:0:13255:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2c2ff68a6e84343 00000020:00000080:1.0:1785787742.761268:0:13255:0:(genops.c:906:class_export_put()) final put ffff91907feb3800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1785787742.761278:0:13255:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1785787742.761288:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff91907feb3800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1785787742.761299:0:13255:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1785787742.761303:0:13255:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1785787742.761307:0:13255:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff91905c493380) has no exports 00000020:00000080:0.0:1785787742.803183:0:13255:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1785787742.803197:0:13255:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1785787742.803203:0:13255:0:(genops.c:906:class_export_put()) final put ffff91907fdde000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1785787742.803207:0:13255:0:(genops.c:865:class_export_destroy()) destroying export ffff91907fdde000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1785787742.803222:0:13255:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1785787742.803545:0:13255:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff91907fdd9800 00000020:01000000:0.0:1785787742.803575:0:13255:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1785787742.803579:0:13255:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1785787742.803600:0:13255:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1785787742.803604:0:13255:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff91905c490000) has no exports 00000020:00000080:0.0:1785787742.803631:0:13255:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1785787742.803637:0:13255:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1785787742.803640:0:13255:0:(genops.c:906:class_export_put()) final put ffff919077aa8800/OSS_uuid 00000020:00000080:0.0:1785787742.803642:0:13255:0:(genops.c:865:class_export_destroy()) destroying export ffff919077aa8800/OSS_uuid for OSS 00000020:01000000:0.0:1785787742.803645:0:13255:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1785787742.803671:0:5815:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1785787742.803851:0:6617:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff91906efba400:6617] 0 exiting: rc = 1 00000100:00100000:0.0:1785787742.803919:0:9394:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff91907fe9bc00:9394] 3 exiting: rc = 0 00000100:00100000:1.0:1785787742.807960:0:6619:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff91905143c600:6619] 2 exiting: rc = 0 00000100:00100000:1.0:1785787742.808075:0:6618:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff91905143c800:6618] 1 exiting: rc = 0 00000100:00100000:0.0:1785787742.808177:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808185:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808191:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808196:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808201:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808206:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808211:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808216:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808220:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808225:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808230:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808240:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808251:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808257:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808262:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808267:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808271:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808276:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808281:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808286:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808290:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808294:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808299:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808303:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808307:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808318:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808323:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808328:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808334:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808339:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808344:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808349:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808354:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808359:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808363:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808368:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808372:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808377:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808381:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808385:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808389:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808393:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808398:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808402:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808408:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808412:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808417:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808422:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808427:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808431:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808436:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808440:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808445:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808449:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.808454:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.809185:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.809192:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.809196:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.809201:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.809207:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.809220:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.809225:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.809230:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.809235:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.811960:0:6620:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff91905143ce00:6620] 0 exiting: rc = 1 00000100:00100000:1.0:1785787742.815418:0:6621:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff919051c2ac00:6621] 1 exiting: rc = 0 00000100:00100000:3.0:1785787742.815678:0:8140:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff91907bb45e00:8140] 2 exiting: rc = 0 00000100:00100000:1.0:1785787742.815809:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.815820:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.815839:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.815846:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.815851:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.815856:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.815871:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.815877:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.815882:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.815887:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.815891:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.815895:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.815899:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.815905:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.815910:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.815925:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.815930:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.815936:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.815941:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.815946:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.815951:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.815955:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.815960:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.815966:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.815971:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.815976:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.815981:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.815985:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.815990:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.815995:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.816001:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.816005:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.816009:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.816024:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.816028:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.816032:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.816036:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.816041:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.816045:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.816059:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.816085:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.816090:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.816094:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.816099:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.816104:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.816109:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.816114:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.816118:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.816124:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.816129:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.816135:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.816140:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.816145:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.816150:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.816155:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.816160:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.816165:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.816170:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.816175:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.816181:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.816186:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.816191:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.816195:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.816200:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.816948:0:6624:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9190491f5600:6624] 2 exiting: rc = 0 00000100:00100000:0.0:1785787742.817326:0:6623:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9190491f4400:6623] 1 exiting: rc = 0 00000100:00100000:0.0:1785787742.817758:0:6622:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff919051c2b200:6622] 0 exiting: rc = 1 00000100:00100000:1.0:1785787742.817873:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.817880:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.817886:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.817901:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.817909:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.817924:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.817930:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.817937:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.817942:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.817948:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.817954:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.817959:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.817973:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.817980:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.817985:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.817990:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.817995:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818000:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818004:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818010:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818015:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818021:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818027:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818032:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818037:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818042:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818056:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818063:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818071:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818077:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818083:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818088:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818094:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818099:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818104:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818110:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818127:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818133:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818144:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818149:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818154:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818159:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818164:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818170:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818175:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818180:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818185:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818191:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818196:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818202:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818208:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818212:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818217:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818222:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818227:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818232:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818238:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818243:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818249:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818254:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818259:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818265:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818270:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.818275:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.828466:0:6625:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9190491f5200:6625] 0 exiting: rc = 1 00000100:00100000:0.0:1785787742.828542:0:6626:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9190491f5c00:6626] 1 exiting: rc = 0 00000100:00100000:1.0:1785787742.829020:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829027:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829031:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829036:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829040:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829045:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829060:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829071:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829077:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829092:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829098:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829103:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829109:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829114:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829118:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829124:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829129:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829134:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829140:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829145:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829150:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829154:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829159:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829164:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829169:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829174:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829179:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829184:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829189:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829194:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829198:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829203:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829207:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829211:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829216:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829221:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829226:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829231:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829235:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829239:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829244:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829248:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829253:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829258:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829270:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829275:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829280:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829284:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829288:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829293:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829298:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829303:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829313:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829319:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829323:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829328:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829333:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829338:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829343:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829353:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829359:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829364:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829369:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.829374:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785787742.831228:0:6627:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff91904527a000:6627] 0 exiting: rc = 1 00000100:00100000:0.0:1785787742.831304:0:6628:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff919045ecb400:6628] 1 exiting: rc = 0 00000100:00100000:1.0:1785787742.833032:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833042:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833057:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833063:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833070:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833083:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833089:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833095:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833109:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833115:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833120:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833125:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833131:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833136:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833142:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833158:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833164:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833183:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833190:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833195:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833200:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833205:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833211:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833216:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833221:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833227:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833232:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833239:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833244:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833264:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833271:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833275:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833282:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833287:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833292:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833298:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833304:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833310:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833315:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833320:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833325:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833345:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833352:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833358:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833363:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833369:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833375:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833381:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833386:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833391:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833403:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833409:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833414:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833433:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833439:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833445:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833450:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833911:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833921:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833927:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833932:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833937:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833943:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785787742.833949:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1785787742.861376:0:13255:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1785787763.171655:0:13871:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg353-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1785787771.797899:0:14283:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1785787771.797902:0:14283:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1785787771.797999:0:14283:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff91905f91f800 00000020:01000004:1.0:1785787771.798012:0:14283:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1785787771.798018:0:14283:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1785787771.798030:0:14283:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff919056a7cd40) 00000020:00000080:1.0:1785787771.798042:0:14283:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1785787771.821109:0:14283:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1785787771.825115:0:14283:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:1.0:1785787771.825445:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 465: rc = 0 00100000:10000000:1.0:1785787771.825581:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 465: rc = 0 00100000:10000000:1.0:1785787771.825706:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 465: rc = 0 00100000:10000000:1.0:1785787771.825797:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 465: rc = 0 00100000:10000000:0.0:1785787771.829149:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 465: rc = 0 00100000:10000000:0.0:1785787771.829543:0:14283:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1785787771.829618:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 465: rc = 0 00100000:10000000:0.0:1785787771.830961:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 467: rc = 0 00100000:10000000:0.0:1785787771.832998:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 149: rc = 0 00100000:10000000:0.0:1785787771.833100:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 149: rc = 0 00100000:10000000:0.0:1785787771.833567:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 559: rc = 0 00100000:10000000:0.0:1785787771.833806:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 559: rc = 0 00100000:10000000:0.0:1785787771.835198:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 559: rc = 0 00100000:10000000:0.0:1785787771.835440:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 559: rc = 0 00100000:10000000:0.0:1785787771.835670:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 559: rc = 0 00100000:10000000:0.0:1785787771.837028:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 559: rc = 0 00100000:10000000:0.0:1785787771.837259:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 559: rc = 0 00100000:10000000:0.0:1785787771.837500:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 559: rc = 0 00100000:10000000:0.0:1785787771.837735:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 559: rc = 0 00100000:10000000:0.0:1785787771.839089:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 559: rc = 0 00100000:10000000:0.0:1785787771.839455:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 559: rc = 0 00100000:10000000:0.0:1785787771.839711:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 559: rc = 0 00100000:10000000:0.0:1785787771.842214:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 160: rc = 0 00100000:10000000:0.0:1785787771.842452:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 160: rc = 0 00100000:10000000:0.0:1785787771.842719:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 160: rc = 0 00100000:10000000:0.0:1785787771.842996:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 160: rc = 0 00100000:10000000:0.0:1785787771.843519:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 160: rc = 0 00100000:10000000:0.0:1785787771.843743:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 160: rc = 0 00100000:10000000:0.0:1785787771.845087:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 160: rc = 0 00100000:10000000:0.0:1785787771.845434:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 160: rc = 0 00100000:10000000:0.0:1785787771.845655:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 160: rc = 0 00100000:10000000:0.0:1785787771.847971:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 160: rc = 0 00100000:10000000:0.0:1785787771.848237:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 160: rc = 0 00100000:10000000:0.0:1785787771.848475:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 160: rc = 0 00100000:10000000:0.0:1785787771.848719:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 160: rc = 0 00100000:10000000:0.0:1785787771.848984:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 160: rc = 0 00100000:10000000:0.0:1785787771.849237:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 160: rc = 0 00100000:10000000:0.0:1785787771.849465:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 160: rc = 0 00100000:10000000:0.0:1785787771.849698:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 160: rc = 0 00100000:10000000:0.0:1785787771.851057:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 160: rc = 0 00100000:10000000:0.0:1785787771.851303:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 160: rc = 0 00100000:10000000:0.0:1785787771.851528:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 160: rc = 0 00100000:10000000:0.0:1785787771.852907:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 160: rc = 0 00100000:10000000:0.0:1785787771.853173:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 160: rc = 0 00100000:10000000:0.0:1785787771.853426:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 160: rc = 0 00100000:10000000:0.0:1785787771.853665:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 160: rc = 0 00100000:10000000:0.0:1785787771.859686:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 160: rc = 0 00100000:10000000:0.0:1785787771.860267:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 160: rc = 0 00100000:10000000:0.0:1785787771.860855:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 160: rc = 0 00100000:10000000:0.0:1785787771.861094:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 160: rc = 0 00100000:10000000:0.0:1785787771.861337:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 160: rc = 0 00100000:10000000:0.0:1785787771.861566:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 160: rc = 0 00100000:10000000:0.0:1785787771.861799:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 160: rc = 0 00100000:10000000:2.0:1785787771.864414:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 160: rc = 0 00100000:10000000:2.0:1785787771.864768:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 153: rc = 0 00100000:10000000:2.0:1785787771.865254:0:14283:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1785787771.865408:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 150: rc = 0 00100000:10000000:2.0:1785787771.865582:0:14283:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1785787771.865652:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 150: rc = 0 00100000:10000000:2.0:1785787771.865877:0:14283:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1785787771.865946:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 150: rc = 0 00100000:10000000:2.0:1785787771.866274:0:14283:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1785787771.866338:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 554: rc = 0 00100000:10000000:2.0:1785787771.866531:0:14283:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1785787771.866601:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 554: rc = 0 00100000:10000000:2.0:1785787771.866778:0:14283:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1785787771.866879:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 554: rc = 0 00000020:00000080:2.0:1785787771.867116:0:14283:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1785787771.867124:0:14283:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1785787771.867135:0:14283:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe2c2ff68a6e85468 00000020:01000004:2.0:1785787771.867143:0:14283:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1785787771.867147:0:14283:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1785787771.867152:0:14283:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91905f91f800 from MGS 00000020:01000004:2.0:1785787771.867156:0:14283:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1785787771.867166:0:14283:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff91905c4919c0) 00000020:00000080:2.0:1785787771.867175:0:14283:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1785787771.867226:0:14283:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91905f91f800 from MGS, refs=2 00080000:01000000:2.0:1785787771.867230:0:14283:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1785787771.867235:0:14283:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe2c2ff68a6e85476 00000100:00100000:2.0:1785787771.867324:0:14283:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1785787771.867427:0:14283:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1785787771.867432:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1785787771.879288:0:14283:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1785787771.879305:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1785787771.892346:0:14283:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1785787771.892976:0:14283:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1785787771.892982:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1785787771.895412:0:14283:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1785787771.895422:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1785787771.896014:0:14283:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1785787771.896021:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1785787771.896628:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787771.896637:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787771.896638:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787771.897434:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787771.897437:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787771.897439:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787771.909100:0:14283:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1785787771.918917:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1785787771.942444:0:14283:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1785787771.942640:0:14283:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1785787771.942644:0:14283:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1785787771.958438:0:14292:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1785787771.958650:0:14283:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1785787771.958766:0:14283:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1785787771.959309:0:14283:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1785787771.959593:0:14283:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1785787771.959751:0:14283:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1785787771.959756:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1785787771.963434:0:14283:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1785787771.963443:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1785787771.964571:0:14283:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1785787771.964578:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1785787771.967869:0:14283:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1785787771.967892:0:14283:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.153@tcp' 00000020:01000004:3.0:1785787771.967894:0:14283:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1785787771.967924:0:14283:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.153@tcp (typ=mgc) 00000020:00000080:3.0:1785787771.967936:0:14283:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.153@tcp (ffff9190507f3380) 00000020:00000080:3.0:1785787771.967950:0:14283:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1785787771.968018:0:14283:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91907fc8a800@MGC192.168.203.153@tcp: add connection 192.168.203.153@tcp at head 00010000:00010000:3.0:1785787771.968271:0:14283:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.153@tcp-0 is initialized 00000040:01000000:3.0:1785787771.968279:0:14283:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.153@tcp ctxt 1 is initialized 10000000:01000000:2.0:1785787771.973983:0:14298:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1785787771.974335:0:14283:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.153@tcp (uuid f9a1da20-2955-44fa-b075-f73628199db8) 00000020:00000080:3.0:1785787771.974359:0:14283:0:(genops.c:1406:class_connect()) connect: client f9a1da20-2955-44fa-b075-f73628199db8, cookie 0xe2c2ff68a6e85484 00000100:00080000:3.0:1785787771.974371:0:14283:0:(import.c:510:import_select_connection()) MGC192.168.203.153@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1785787771.974378:0:14283:0:(import.c:624:import_select_connection()) MGC192.168.203.153@tcp: import ffff91907fc8a800 using connection 192.168.203.153@tcp/0@lo 00000100:00100000:3.0:1785787771.974410:0:14283:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff919076d8a300 x1872533770043264/t0(0) o250->MGC192.168.203.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1785787771.974433:0:14283:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import f9a1da20-2955-44fa-b075-f73628199db8->MGS 00000020:01000004:3.0:1785787771.974463:0:14283:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1785787771.974468:0:14283:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1785787771.974482:0:14283:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9190507f0000) 00000020:00000080:3.0:1785787771.974492:0:14283:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:1.0:1785787771.980715:0:14297:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:1.0:1785787771.981674:0:3332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f9a1da20-2955-44fa-b075-f73628199db8:3332:1872533770043264:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1785787771.981744:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787771.982200:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770043264 00000100:00100000:1.0:1785787771.982207:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770043264 00000100:00100000:1.0:1785787771.982239:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1785787771.982246:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906ef7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3332:x1872533770043264:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1785787771.982272:0:14294:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from f9a1da20-2955-44fa-b075-f73628199db8@0@lo t0 exp 0000000000000000 cur 559 last 0 00000020:00000080:1.0:1785787771.982296:0:14294:0:(genops.c:1406:class_connect()) connect: client f9a1da20-2955-44fa-b075-f73628199db8, cookie 0xe2c2ff68a6e85492 00000100:00080000:1.0:1785787771.982421:0:14294:0:(import.c:65:import_set_state_nolock()) ffff91907fe09800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1785787771.982474:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906ef7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+5:3332:x1872533770043264:12345-0@lo:250:mount.lustre.0 Request processed in 227us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787771.982483:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1785787771.982524:0:3332:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.153@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1785787771.983706:0:3332:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.153@tcp: connect to target with instance 0 00000100:00080000:1.0:1785787771.983716:0:3332:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.153@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1785787771.983721:0:3332:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1785787771.983725:0:3332:0:(import.c:65:import_set_state_nolock()) ffff91907fc8a800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1785787771.983727:0:3332:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1785787771.983737:0:3332:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1785787771.983742:0:3332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f9a1da20-2955-44fa-b075-f73628199db8:3332:1872533770043264:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1785787771.991590:0:14283:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1785787771.991746:0:14283:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1785787771.991752:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1785787772.006147:0:14283:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1785787772.006275:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1785787772.009263:0:14283:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1785787772.009274:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1785787772.009919:0:14283:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1785787772.010087:0:14283:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1785787772.010092:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1785787772.011958:0:14283:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1785787772.011966:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1785787772.088376:0:14283:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1785787772.088544:0:14283:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1785787772.088550:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1785787772.090945:0:14283:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1785787772.090956:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1785787772.095346:0:14283:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1785787772.095493:0:14283:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1785787772.095504:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1785787772.100507:0:14283:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1785787772.100519:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1785787772.108475:0:14283:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1785787772.108626:0:14283:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1785787772.108631:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1785787772.116996:0:14283:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1785787772.117031:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1785787772.119529:0:14283:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1785787772.119681:0:14283:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1785787772.119686:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1785787772.121242:0:14283:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1785787772.121250:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1785787772.157604:0:14283:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1785787772.158911:0:14283:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1785787772.158922:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1785787772.165146:0:14283:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1785787772.165161:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1785787772.171698:0:14283:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1785787772.171712:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1785787772.172468:0:14283:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1785787772.172489:0:14283:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1785787772.172494:0:14283:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.153@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1785787772.172609:0:14283:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.153@tcp ctxt 0 is initialized 00000020:01000004:1.0:1785787772.172647:0:14283:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.153@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1785787772.172651:0:14283:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1785787772.172653:0:14283:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1785787772.172655:0:14283:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785787772.172656:0:14283:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1785787772.172657:0:14283:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785787772.172658:0:14283:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785787772.172660:0:14283:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1785787772.172661:0:14283:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1785787772.172663:0:14283:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785787772.172664:0:14283:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1785787772.172666:0:14283:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1785787772.172668:0:14283:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1785787772.172670:0:14283:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1785787772.172671:0:14283:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785787772.172672:0:14283:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1785787772.172673:0:14283:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785787772.172674:0:14283:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785787772.172675:0:14283:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1785787772.172677:0:14283:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1785787772.172678:0:14283:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785787772.172679:0:14283:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1785787772.172703:0:14283:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1785787772.172723:0:14283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd92a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14283:1872533770043392:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1785787772.172787:0:14283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787772.172878:0:14283:0:(client.c:2702:ptlrpc_set_wait()) set ffff919042b4b900 going to sleep for 11 seconds 00000100:00100000:2.0:1785787772.172982:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770043392 00000100:00100000:2.0:1785787772.172989:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770043392 00000100:00100000:2.0:1785787772.173025:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1785787772.173032:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076f19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+5:14283:x1872533770043392:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1785787772.173066:0:14296:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1785787772.173069:0:14296:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1785787772.173072:0:14296:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1785787772.173341:0:14317:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1785787772.173614:0:14296:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1785787772.174648:0:14318:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1785787772.174653:0:14318:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1785787772.174655:0:14318:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1785787772.174689:0:14318:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1785787772.174929:0:14296:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1785787772.174936:0:14296:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1785787772.210535:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076f19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+5:14283:x1872533770043392:12345-0@lo:253:mount.lustre.0 Request processed in 37496us (37741us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787772.210549:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1785787772.210638:0:14283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd92a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14283:1872533770043392:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1785787772.210652:0:14283:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1785787772.210655:0:14283:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1785787772.210656:0:14283:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1785787772.210658:0:14283:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785787772.210659:0:14283:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1785787772.210660:0:14283:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785787772.210661:0:14283:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785787772.210663:0:14283:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1785787772.210664:0:14283:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1785787772.210666:0:14283:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785787772.210667:0:14283:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1785787772.210684:0:14283:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91905f91f800 from lustre-MDT0000 10000000:01000000:1.0:1785787772.210720:0:14283:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1785787772.210724:0:14283:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1785787772.210728:0:14283:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9190507f3380 10000000:01000000:1.0:1785787772.210732:0:14283:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1785787772.210740:0:14283:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9190507f3380 from 1 10000000:01000000:1.0:1785787772.210743:0:14283:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1785787772.210780:0:14283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff91908206b600/0xe2c2ff68a6e85499 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787772.210791:0:14283:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff91908206b600/0xe2c2ff68a6e85499 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787772.210802:0:14283:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff91908206b600/0xe2c2ff68a6e85499 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787772.210821:0:14283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd92a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14283:1872533770043520:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1785787772.210891:0:14283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787772.210935:0:14283:0:(client.c:2702:ptlrpc_set_wait()) set ffff919042b4b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785787772.211029:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770043520 00000100:00100000:2.0:1785787772.211036:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770043520 00000100:00100000:2.0:1785787772.211072:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1785787772.211079:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076f18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+5:14283:x1872533770043520:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1785787772.211091:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787772.211104:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91904677dc00/0xe2c2ff68a6e854a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e85499 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787772.211145:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91904677dc00/0xe2c2ff68a6e854a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e85499 expref: 6 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787772.211157:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91904677dc00/0xe2c2ff68a6e854a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e85499 expref: 6 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787772.211166:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677dc00, rc 0) 00000100:00100000:2.0:1785787772.211193:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076f18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+6:14283:x1872533770043520:12345-0@lo:101:mount.lustre.0 Request processed in 115us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787772.211199:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1785787772.211273:0:14283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd92a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14283:1872533770043520:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1785787772.211285:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff91908206b600/0xe2c2ff68a6e85499 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e854a0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787772.211293:0:14283:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff91908206b600/0xe2c2ff68a6e85499 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e854a0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787772.211331:0:14283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd92a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14283:1872533770043648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1785787772.211354:0:14283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787772.211379:0:14283:0:(client.c:2702:ptlrpc_set_wait()) set ffff919042b4b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785787772.211413:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770043648 00000100:00100000:2.0:1785787772.211417:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770043648 00000100:00100000:2.0:1785787772.211436:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1785787772.211441:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076f1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+6:14283:x1872533770043648:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785787772.211612:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076f1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+6:14283:x1872533770043648:12345-0@lo:501:mount.lustre.0 Request processed in 170us (256us total) trans 0 rc -2/-2 00000100:00100000:2.0:1785787772.211619:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1785787772.211676:0:14283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd92a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14283:1872533770043648:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1785787772.211696:0:14283:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1785787772.211718:0:14283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff91908206b600/0xe2c2ff68a6e85499 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e854a0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787772.211726:0:14283:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff91908206b600/0xe2c2ff68a6e85499 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e854a0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785787772.211733:0:14283:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91905f91f800 10000000:01000000:1.0:1785787772.211737:0:14283:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1785787772.211740:0:14283:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff91905f91f800 10000000:01000000:1.0:1785787772.211743:0:14283:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1785787772.211745:0:14283:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff91905f91f800 from 1 10000000:01000000:1.0:1785787772.211747:0:14283:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1785787772.211760:0:14283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff91908206a200/0xe2c2ff68a6e854a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787772.211767:0:14283:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff91908206a200/0xe2c2ff68a6e854a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787772.211780:0:14283:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff91908206a200/0xe2c2ff68a6e854a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787772.211792:0:14283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd92a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14283:1872533770043776:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1785787772.211816:0:14283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787772.211874:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770043776 00000100:00100000:1.0:1785787772.211878:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770043776 00000100:00100000:1.0:1785787772.211901:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1785787772.211907:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076f18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+6:14283:x1872533770043776:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1785787772.211914:0:14294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787772.211923:0:14294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91908206ae00/0xe2c2ff68a6e854ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e854a7 expref: -99 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787772.211936:0:14294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91908206ae00/0xe2c2ff68a6e854ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e854a7 expref: 7 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787772.211944:0:14294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91908206ae00/0xe2c2ff68a6e854ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e854a7 expref: 7 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787772.211950:0:14294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91908206ae00, rc 0) 00000100:00100000:1.0:1785787772.211973:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076f18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+7:14283:x1872533770043776:12345-0@lo:101:mount.lustre.0 Request processed in 66us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787772.211978:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1785787772.212080:0:14283:0:(client.c:2702:ptlrpc_set_wait()) set ffff919042b4b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785787772.212092:0:14283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd92a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14283:1872533770043776:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1785787772.212102:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff91908206a200/0xe2c2ff68a6e854a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e854ae expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787772.212115:0:14283:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff91908206a200/0xe2c2ff68a6e854a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e854ae expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785787772.212126:0:14283:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1785787772.212129:0:14283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff91908206a200/0xe2c2ff68a6e854a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e854ae expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787772.212136:0:14283:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff91908206a200/0xe2c2ff68a6e854a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e854ae expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785787772.212143:0:14283:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1785787772.212146:0:14283:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1785787772.212149:0:14283:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff91905f91f800 10000000:01000000:1.0:1785787772.212152:0:14283:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1785787772.212155:0:14283:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1785787772.212157:0:14283:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1785787772.212169:0:14283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff91908206bc00/0xe2c2ff68a6e854b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787772.212176:0:14283:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff91908206bc00/0xe2c2ff68a6e854b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787772.212184:0:14283:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff91908206bc00/0xe2c2ff68a6e854b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787772.212195:0:14283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd92a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14283:1872533770043904:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1785787772.212217:0:14283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787772.212227:0:14283:0:(client.c:2702:ptlrpc_set_wait()) set ffff919042b4b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785787772.212552:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770043904 00000100:00100000:2.0:1785787772.212556:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770043904 00000100:00100000:2.0:1785787772.212582:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1785787772.212589:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076f19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+7:14283:x1872533770043904:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1785787772.212596:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787772.212604:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91904677d800/0xe2c2ff68a6e854bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e854b5 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787772.212616:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91904677d800/0xe2c2ff68a6e854bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e854b5 expref: 8 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787772.212635:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91904677d800/0xe2c2ff68a6e854bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e854b5 expref: 8 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787772.212641:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677d800, rc 0) 00000100:00100000:2.0:1785787772.212668:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076f19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+8:14283:x1872533770043904:12345-0@lo:101:mount.lustre.0 Request processed in 80us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787772.212674:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1785787772.212749:0:14283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd92a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14283:1872533770043904:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1785787772.212759:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff91908206bc00/0xe2c2ff68a6e854b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e854bc expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787772.212766:0:14283:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff91908206bc00/0xe2c2ff68a6e854b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e854bc expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787772.212800:0:14283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076d89f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14283:1872533770044032:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1785787772.212859:0:14283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787772.212881:0:14283:0:(client.c:2702:ptlrpc_set_wait()) set ffff91904838bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1785787772.212978:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770044032 00000100:00100000:2.0:1785787772.212982:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770044032 00000100:00100000:2.0:1785787772.213001:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1785787772.213007:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076f1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+8:14283:x1872533770044032:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785787772.213279:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076f1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+9:14283:x1872533770044032:12345-0@lo:501:mount.lustre.0 Request processed in 272us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787772.213286:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1785787772.213356:0:14283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076d89f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14283:1872533770044032:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1785787772.213388:0:14283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076d89f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14283:1872533770044160:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1785787772.213424:0:14283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787772.213449:0:14283:0:(client.c:2702:ptlrpc_set_wait()) set ffff91904838bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1785787772.213494:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770044160 00000100:00100000:2.0:1785787772.213498:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770044160 00000100:00100000:2.0:1785787772.213524:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1785787772.213530:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076f1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+9:14283:x1872533770044160:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1785787772.213798:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076f1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+9:14283:x1872533770044160:12345-0@lo:503:mount.lustre.0 Request processed in 268us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787772.213805:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1785787772.213948:0:14283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076d89f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14283:1872533770044160:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1785787772.215061:0:14319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076d89f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9a1da20-2955-44fa-b075-f73628199db8:14319:1872533770044288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785787772.215094:0:14319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787772.215121:0:14319:0:(client.c:2702:ptlrpc_set_wait()) set ffff91904838b180 going to sleep for 11 seconds 00000100:00100000:2.0:1785787772.215164:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770044288 00000100:00100000:2.0:1785787772.215169:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770044288 00000100:00100000:2.0:1785787772.215201:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1785787772.215208:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076f1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+9:14319:x1872533770044288:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785787772.217996:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076f1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+9:14319:x1872533770044288:12345-0@lo:502:llog_process_th.0 Request processed in 2782us (2895us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787772.218019:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1785787772.218327:0:14319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076d89f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9a1da20-2955-44fa-b075-f73628199db8:14319:1872533770044288:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1785787772.218377:0:14319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1785787772.218387:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785787772.218389:0:14319:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1785787772.218393:0:14319:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1785787772.218396:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1785787772.218409:0:14319:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff919056a799c0) 00000020:00000080:1.0:1785787772.218424:0:14319:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1785787772.218429:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1785787772.218495:0:14319:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:1.0:1785787772.218502:0:14319:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe2c2ff68a6e854ca 00000020:00000080:1.0:1785787772.218693:0:14319:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1785787772.218697:0:14319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1785787772.218701:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785787772.218703:0:14319:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1785787772.219891:0:14319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1785787772.219898:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785787772.219899:0:14319:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1785787772.219904:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1785787772.219913:0:14319:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff919056a7b380) 00000020:00000080:1.0:1785787772.219924:0:14319:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1785787772.219928:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1785787772.219930:0:14319:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1785787772.219933:0:14319:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1785787772.219939:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1785787772.219985:0:14319:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91905f91f800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1785787772.219997:0:14319:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff919056a78000) 00000020:00000080:1.0:1785787772.220006:0:14319:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1785787772.220064:0:14319:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1785787772.220070:0:14319:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe2c2ff68a6e854df 00000020:00000080:1.0:1785787772.220167:0:14319:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1785787772.220173:0:14319:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1785787772.220183:0:14319:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xe2c2ff68a6e854e6 00080000:01000000:1.0:1785787772.220188:0:14319:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:1.0:1785787772.220191:0:14319:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe2c2ff68a6e854ed 00010000:00010000:0.0:1785787772.339274:0:14319:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1785787772.340497:0:14319:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:0.0:1785787772.341443:0:14319:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1785787772.345174:0:14319:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9190507f4d40) 00000020:00000080:3.0:1785787772.345193:0:14319:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1785787772.345272:0:14319:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:3.0:1785787772.345288:0:14319:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe2c2ff68a6e854fb 00000020:00000080:3.0:1785787772.345487:0:14319:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1785787772.354969:0:14319:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xe2c2ff68a6e85502 00000020:00000080:0.0:1785787772.363482:0:14319:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1785787772.363494:0:14319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785787772.363501:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785787772.363503:0:14319:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1785787772.363509:0:14319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785787772.363514:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785787772.363516:0:14319:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1785787772.363520:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1785787772.363557:0:14319:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1785787772.363574:0:14319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785787772.363577:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785787772.363588:0:14319:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1785787772.363592:0:14319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1785787772.363593:0:14319:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #10 00000020:01000000:0.0:1785787772.363595:0:14319:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1785787772.363596:0:14319:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1785787772.363598:0:14319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1785787772.363601:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785787772.363602:0:14319:0:(obd_config.c:1561:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:0.0:1785787772.363615:0:14319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1785787772.363618:0:14319:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1785787772.363621:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785787772.363622:0:14319:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1785787772.363625:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1785787772.363630:0:14319:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.153@tcp to nid 0x20000c0a8cb99 (192.168.203.153@tcp) 00000020:01000000:0.0:1785787772.363661:0:14319:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1785787772.363665:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1785787772.363679:0:14319:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9190515c8000) 00000020:00000080:0.0:1785787772.363694:0:14319:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1785787772.363698:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1785787772.363754:0:14319:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1785787772.363759:0:14319:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:0.0:1785787772.363764:0:14319:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe2c2ff68a6e85510 00010000:00080000:0.0:1785787772.363801:0:14319:0:(ldlm_lib.c:102:import_set_conn()) imp ffff919077066800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.153@tcp at head 00010000:00010000:0.0:1785787772.364156:0:14319:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1785787772.364533:0:14319:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1785787772.364575:0:14319:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1785787772.371430:0:14319:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1785787772.371488:0:14319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1785787772.371563:0:14319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1785787772.375444:0:14323:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1785787772.375449:0:14323:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1785787772.382397:0:14319:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1785787772.382409:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1785787772.382442:0:14319:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1785787772.382459:0:14319:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe2c2ff68a6e85517 00000100:00080000:2.0:1785787772.382468:0:14319:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1785787772.382473:0:14319:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff919077066800 using connection 192.168.203.153@tcp/0@lo 00000100:00100000:2.0:1785787772.382505:0:14319:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91907764ca80 x1872533770044416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1785787772.382531:0:14319:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1785787772.382719:0:14319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1785787772.382723:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785787772.382725:0:14319:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1785787772.382728:0:14319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1785787772.382731:0:14319:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1785787772.382733:0:14319:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1785787772.382734:0:14319:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1785787772.382736:0:14319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1785787772.382738:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785787772.382739:0:14319:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1785787772.382742:0:14319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1785787772.382746:0:14319:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1785787772.382748:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785787772.382750:0:14319:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1785787772.382753:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1785787772.382756:0:14319:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.153@tcp to nid 0x20000c0a8cb99 (192.168.203.153@tcp) 00000020:01000000:2.0:1785787772.382776:0:14319:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1785787772.382778:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1785787772.382790:0:14319:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff91905c490000) 00000020:00000080:2.0:1785787772.382800:0:14319:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1785787772.382811:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1785787772.383001:0:14319:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1785787772.383009:0:14319:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:2.0:1785787772.383015:0:14319:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe2c2ff68a6e85525 00010000:00080000:2.0:1785787772.383042:0:14319:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91905fad9800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.153@tcp at head 00010000:00010000:2.0:1785787772.383220:0:14319:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1785787772.383434:0:14319:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1785787772.383454:0:14319:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1785787772.383795:0:3332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3332:1872533770044416:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1785787772.383877:0:3332:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1872533770044416 offset 0 length 520: 4 00000040:00080000:2.0:1785787772.384968:0:14319:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1785787772.385050:0:14319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1785787772.385115:0:14319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1785787772.386744:0:14325:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1785787772.386749:0:14325:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1785787772.388060:0:14319:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1785787772.388070:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1785787772.388096:0:14319:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1785787772.388113:0:14319:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe2c2ff68a6e8552c 00000100:00080000:2.0:1785787772.388121:0:14319:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1785787772.388126:0:14319:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91905fad9800 using connection 192.168.203.153@tcp/0@lo 00000100:00100000:2.0:1785787772.388157:0:14319:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91907764ed80 x1872533770044544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1785787772.388173:0:14319:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1785787772.388225:0:14319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1785787772.388229:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785787772.388231:0:14319:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1785787772.388234:0:14319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1785787772.388237:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785787772.388238:0:14319:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1785787772.388241:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1785787772.388243:0:14319:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1785787772.388245:0:14319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1785787772.388247:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785787772.388248:0:14319:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1785787772.388256:0:14319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1785787772.388259:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785787772.388260:0:14319:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1785787772.388264:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1785787772.388385:0:14319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9a1da20-2955-44fa-b075-f73628199db8:14319:1872533770044672:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785787772.388451:0:14319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787772.388521:0:3332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3332:1872533770044544:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1785787772.388558:0:3332:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1872533770044544 offset 0 length 520: 4 00000100:00100000:2.0:1785787772.389008:0:14319:0:(client.c:2702:ptlrpc_set_wait()) set ffff919051486600 going to sleep for 11 seconds 00000100:00100000:0.0:1785787772.391389:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770044672 00000100:00100000:0.0:1785787772.391399:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770044672 00000100:00100000:0.0:1785787772.391473:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1785787772.391482:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076f18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+9:14319:x1872533770044672:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785787772.393017:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076f18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+9:14319:x1872533770044672:12345-0@lo:502:llog_process_th.0 Request processed in 1535us (4563us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787772.393026:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1785787772.393112:0:14319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9a1da20-2955-44fa-b075-f73628199db8:14319:1872533770044672:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1785787772.393142:0:14319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1785787772.393150:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785787772.393152:0:14319:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1785787772.393156:0:14319:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1785787772.393912:0:14283:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1785787772.393929:0:14283:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1785787772.393952:0:14283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff91908206bc00/0xe2c2ff68a6e854b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e854bc expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787772.393962:0:14283:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff91908206bc00/0xe2c2ff68a6e854b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e854bc expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785787772.393969:0:14283:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff91905f91f800 from 1 10000000:01000000:1.0:1785787772.393971:0:14283:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1785787772.393999:0:14283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff91908206a400/0xe2c2ff68a6e85533 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787772.394006:0:14283:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff91908206a400/0xe2c2ff68a6e85533 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787772.394015:0:14283:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff91908206a400/0xe2c2ff68a6e85533 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787772.394043:0:14283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14283:1872533770044800:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1785787772.394077:0:14283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787772.399415:0:14283:0:(client.c:2702:ptlrpc_set_wait()) set ffff919043100780 going to sleep for 11 seconds 00000100:00100000:0.0:1785787772.401954:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770044800 00000100:00100000:0.0:1785787772.401965:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770044800 00000100:00100000:0.0:1785787772.402017:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1785787772.402027:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076f18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+9:14283:x1872533770044800:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1785787772.402056:0:14294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787772.402077:0:14294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919052f5f400/0xe2c2ff68a6e8553a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e85533 expref: -99 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787772.402103:0:14294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919052f5f400/0xe2c2ff68a6e8553a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e85533 expref: 10 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787772.402115:0:14294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919052f5f400/0xe2c2ff68a6e8553a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e85533 expref: 10 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787772.402124:0:14294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919052f5f400, rc 0) 00000100:00100000:0.0:1785787772.402239:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076f18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+10:14283:x1872533770044800:12345-0@lo:101:mount.lustre.0 Request processed in 214us (8161us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787772.402246:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1785787772.404427:0:14283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14283:1872533770044800:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1785787772.404450:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff91908206a400/0xe2c2ff68a6e85533 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e8553a expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787772.404461:0:14283:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff91908206a400/0xe2c2ff68a6e85533 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e8553a expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787772.411119:0:14283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14283:1872533770044928:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1785787772.411201:0:14283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787772.411275:0:14283:0:(client.c:2702:ptlrpc_set_wait()) set ffff919077954e40 going to sleep for 11 seconds 00000100:00100000:0.0:1785787772.414407:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770044928 00000100:00100000:0.0:1785787772.414418:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770044928 00000100:00100000:0.0:1785787772.414507:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1785787772.414516:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076f1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+10:14283:x1872533770044928:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1785787772.414540:0:14294:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1785787772.414547:0:14294:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1785787772.414650:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076f1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+10:14283:x1872533770044928:12345-0@lo:256:mount.lustre.0 Request processed in 135us (3448us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787772.414657:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1785787772.414738:0:14283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14283:1872533770044928:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1785787772.415310:0:14283:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1785787772.415325:0:14283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff91908206a400/0xe2c2ff68a6e85533 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e8553a expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787772.415336:0:14283:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff91908206a400/0xe2c2ff68a6e85533 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e8553a expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785787772.415364:0:14283:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff91905f91f800 from 1 10000000:01000000:2.0:1785787772.415367:0:14283:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1785787772.415395:0:14283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff91904677d200/0xe2c2ff68a6e85541 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787772.415403:0:14283:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff91904677d200/0xe2c2ff68a6e85541 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787772.415418:0:14283:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff91904677d200/0xe2c2ff68a6e85541 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787772.415434:0:14283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14283:1872533770045056:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1785787772.415461:0:14283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787772.422392:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770045056 00000100:00100000:1.0:1785787772.422405:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770045056 00000100:00100000:0.0:1785787772.422490:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1785787772.422503:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076f19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+10:14283:x1872533770045056:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1785787772.422519:0:14294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787772.422539:0:14294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919052f5fa00/0xe2c2ff68a6e85548 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e85541 expref: -99 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787772.422591:0:14294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919052f5fa00/0xe2c2ff68a6e85548 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e85541 expref: 11 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787772.422603:0:14294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919052f5fa00/0xe2c2ff68a6e85548 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e85541 expref: 11 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787772.422613:0:14294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919052f5fa00, rc 0) 00000100:00100000:0.0:1785787772.422663:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076f19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+11:14283:x1872533770045056:12345-0@lo:101:mount.lustre.0 Request processed in 164us (7201us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787772.422670:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1785787772.422782:0:14283:0:(client.c:2702:ptlrpc_set_wait()) set ffff919077954e40 going to sleep for 11 seconds 00000100:00100000:3.0:1785787772.422806:0:14283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14283:1872533770045056:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1785787772.422822:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff91904677d200/0xe2c2ff68a6e85541 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e85548 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787772.422872:0:14283:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff91904677d200/0xe2c2ff68a6e85541 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e85548 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787772.422946:0:14283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076d88700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14283:1872533770045184:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1785787772.422975:0:14283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787772.422991:0:14283:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905620e180 going to sleep for 11 seconds 00000100:00100000:2.0:1785787772.425370:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770045184 00000100:00100000:2.0:1785787772.425378:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770045184 00000100:00100000:2.0:1785787772.425408:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1785787772.425414:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076f19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+11:14283:x1872533770045184:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785787772.425770:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076f19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+11:14283:x1872533770045184:12345-0@lo:501:mount.lustre.0 Request processed in 355us (2793us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787772.425777:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1785787772.426699:0:14283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076d88700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14283:1872533770045184:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1785787772.426745:0:14283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076d88700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14283:1872533770045312:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1785787772.426783:0:14283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787772.426809:0:14283:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905620e180 going to sleep for 11 seconds 00000100:00100000:2.0:1785787772.426977:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770045312 00000100:00100000:2.0:1785787772.426981:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770045312 00000100:00100000:2.0:1785787772.427003:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1785787772.427009:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076f1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+11:14283:x1872533770045312:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1785787772.427139:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076f1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+11:14283:x1872533770045312:12345-0@lo:503:mount.lustre.0 Request processed in 129us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787772.427146:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1785787772.427657:0:14283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076d88700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14283:1872533770045312:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1785787772.428653:0:14327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076d88700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9a1da20-2955-44fa-b075-f73628199db8:14327:1872533770045440:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785787772.428686:0:14327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787772.428761:0:14327:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905064a600 going to sleep for 11 seconds 00000100:00100000:1.0:1785787772.428808:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770045440 00000100:00100000:1.0:1785787772.428812:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770045440 00000100:00100000:1.0:1785787772.428962:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1785787772.428970:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076f1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+11:14327:x1872533770045440:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785787772.429144:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076f1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+11:14327:x1872533770045440:12345-0@lo:502:llog_process_th.0 Request processed in 175us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787772.429151:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1785787772.429257:0:14327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076d88700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9a1da20-2955-44fa-b075-f73628199db8:14327:1872533770045440:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1785787772.429275:0:14327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1785787772.429330:0:14327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785787772.429333:0:14327:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1785787772.429341:0:14327:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff91905f91f800 00000020:00000080:2.0:1785787772.429343:0:14327:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1785787772.429355:0:14327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1785787772.429358:0:14327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785787772.429359:0:14327:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1785787772.429362:0:14327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1785787772.429364:0:14327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785787772.429365:0:14327:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1785787772.429369:0:14327:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff91905f91f800 00000020:00000080:2.0:1785787772.429370:0:14327:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1785787772.429465:0:14327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1785787772.429469:0:14327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785787772.429470:0:14327:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1785787772.429473:0:14327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1785787772.429475:0:14327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785787772.429476:0:14327:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1785787772.429480:0:14327:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91905f91f800 00000020:00000080:2.0:1785787772.429482:0:14327:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1785787772.437785:0:14327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9a1da20-2955-44fa-b075-f73628199db8:14327:1872533770045568:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785787772.437892:0:14327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787772.437928:0:14327:0:(client.c:2702:ptlrpc_set_wait()) set ffff91904838bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1785787772.438060:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770045568 00000100:00100000:0.0:1785787772.438068:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770045568 00000100:00100000:0.0:1785787772.438648:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1785787772.438658:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076f1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+11:14327:x1872533770045568:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785787772.440889:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076f1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+11:14327:x1872533770045568:12345-0@lo:502:llog_process_th.0 Request processed in 2222us (2994us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787772.440900:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1785787772.449928:0:14327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9a1da20-2955-44fa-b075-f73628199db8:14327:1872533770045568:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1785787772.449993:0:14327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1785787772.450000:0:14327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785787772.450003:0:14327:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1785787772.450009:0:14327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1785787772.450780:0:14283:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1785787772.450800:0:14283:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1785787772.450822:0:14283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff91904677d200/0xe2c2ff68a6e85541 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e85548 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787772.450863:0:14283:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff91904677d200/0xe2c2ff68a6e85541 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e85548 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785787772.451655:0:14283:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1785787772.451658:0:14283:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91905f91f800 10000000:01000000:2.0:1785787772.451661:0:14283:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91905f91f800 10000000:01000000:2.0:1785787772.451665:0:14283:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1785787772.451671:0:14283:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91905f91f800 from 1 10000000:01000000:2.0:1785787772.451678:0:14283:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1785787772.451818:0:14283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff91904677c600/0xe2c2ff68a6e8554f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787772.451857:0:14283:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff91904677c600/0xe2c2ff68a6e8554f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787772.451868:0:14283:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff91904677c600/0xe2c2ff68a6e8554f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787772.452030:0:14283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14283:1872533770045696:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1785787772.452086:0:14283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787772.452126:0:14283:0:(client.c:2702:ptlrpc_set_wait()) set ffff919042b4b900 going to sleep for 11 seconds 00000100:00100000:0.0:1785787772.452658:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770045696 00000100:00100000:0.0:1785787772.452664:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770045696 00000100:00100000:0.0:1785787772.452760:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1785787772.452770:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+11:14283:x1872533770045696:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1785787772.452782:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787772.452794:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919052f5e800/0xe2c2ff68a6e85556 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e8554f expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787772.452816:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919052f5e800/0xe2c2ff68a6e85556 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e8554f expref: 12 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787772.452863:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919052f5e800/0xe2c2ff68a6e85556 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e8554f expref: 12 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787772.452871:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919052f5e800, rc 0) 00000100:00100000:0.0:1785787772.452969:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+12:14283:x1872533770045696:12345-0@lo:101:mount.lustre.0 Request processed in 199us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787772.452976:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1785787772.454364:0:14283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14283:1872533770045696:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1785787772.454384:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff91904677c600/0xe2c2ff68a6e8554f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e85556 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787772.454395:0:14283:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff91904677c600/0xe2c2ff68a6e8554f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e85556 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787772.454454:0:14283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14283:1872533770045824:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785787772.454487:0:14283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787772.454512:0:14283:0:(client.c:2702:ptlrpc_set_wait()) set ffff919042b4b900 going to sleep for 11 seconds 00000100:00100000:0.0:1785787772.454786:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770045824 00000100:00100000:0.0:1785787772.454791:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770045824 00000100:00100000:0.0:1785787772.454855:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1785787772.454864:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+12:14283:x1872533770045824:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1785787772.455183:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+12:14283:x1872533770045824:12345-0@lo:501:mount.lustre.0 Request processed in 319us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787772.455191:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1785787772.455852:0:14283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14283:1872533770045824:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785787772.455896:0:14283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14283:1872533770045952:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1785787772.455934:0:14283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787772.455954:0:14283:0:(client.c:2702:ptlrpc_set_wait()) set ffff919042b4b900 going to sleep for 11 seconds 00000100:00100000:0.0:1785787772.460807:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770045952 00000100:00100000:0.0:1785787772.460819:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770045952 00000100:00100000:0.0:1785787772.460901:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1785787772.460909:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+12:14283:x1872533770045952:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1785787772.461116:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+12:14283:x1872533770045952:12345-0@lo:503:mount.lustre.0 Request processed in 207us (5181us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787772.461125:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1785787772.461995:0:14283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14283:1872533770045952:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1785787772.466059:0:14332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076d89880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9a1da20-2955-44fa-b075-f73628199db8:14332:1872533770046080:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785787772.466127:0:14332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787772.466168:0:14332:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905079e780 going to sleep for 11 seconds 00000100:00100000:1.0:1785787772.467379:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770046080 00000100:00100000:1.0:1785787772.467386:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770046080 00000100:00100000:1.0:1785787772.467423:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1785787772.467431:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+12:14332:x1872533770046080:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785787772.469022:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+12:14332:x1872533770046080:12345-0@lo:502:llog_process_th.0 Request processed in 1588us (2891us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787772.469032:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1785787772.469101:0:14332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076d89880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9a1da20-2955-44fa-b075-f73628199db8:14332:1872533770046080:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1785787772.469163:0:14332:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1785787772.469185:0:14332:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff91905d4a4d40) 00000020:00000080:1.0:1785787772.469204:0:14332:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1785787772.471382:0:14332:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91905f91f800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1785787772.471388:0:14332:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91905f91f800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1785787772.471391:0:14332:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91905f91f800 4 00010000:00080000:1.0:1785787772.471419:0:14332:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91907fc8d000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.153@tcp at head 00010000:00010000:1.0:1785787772.488208:0:14332:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1785787772.488297:0:14332:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1785787772.488331:0:14332:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1785787772.488344:0:14332:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xe2c2ff68a6e85564 00000100:00080000:1.0:1785787772.488354:0:14332:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1785787772.488359:0:14332:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff91907fc8d000 using connection 192.168.203.153@tcp/0@lo 00000100:00100000:1.0:1785787772.488391:0:14332:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91907fd90700 x1872533770046208/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1785787772.488447:0:3332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3332:1872533770046208:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1785787772.488563:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1785787772.488617:0:14332:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1785787772.490465:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770046208 00000100:00100000:3.0:1785787772.490475:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770046208 00000100:00100000:3.0:1785787772.490513:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1785787772.490521:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41391500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1872533770046208:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1785787772.493144:0:14332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd92300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9a1da20-2955-44fa-b075-f73628199db8:14332:1872533770046336:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785787772.493205:0:14332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787772.493239:0:14332:0:(client.c:2702:ptlrpc_set_wait()) set ffff919076ddf000 going to sleep for 11 seconds 00000100:00100000:3.0:1785787772.493431:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41391500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3332:x1872533770046208:12345-0@lo:38:llog_process_th.0 Request processed in 2907us (4866us total) trans 0 rc -11/-11 00000100:00100000:3.0:1785787772.493441:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1785787772.499085:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770046336 00000100:00100000:1.0:1785787772.499096:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770046336 00000100:00100000:1.0:1785787772.499152:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1785787772.499161:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+12:14332:x1872533770046336:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785787772.499411:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+12:14332:x1872533770046336:12345-0@lo:502:llog_process_th.0 Request processed in 251us (6205us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787772.499419:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1785787772.499539:0:14332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd92300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9a1da20-2955-44fa-b075-f73628199db8:14332:1872533770046336:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1785787772.499568:0:14332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000100:00100000:0.0:1785787772.499787:0:3332:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1785787772.499795:0:3332:0:(import.c:65:import_set_state_nolock()) ffff91907fc8d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1785787772.499805:0:3332:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1785787772.499809:0:3332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3332:1872533770046208:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1785787772.500784:0:14283:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1785787772.500809:0:14283:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1785787772.500857:0:14283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff91904677c600/0xe2c2ff68a6e8554f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e85556 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787772.500869:0:14283:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff91904677c600/0xe2c2ff68a6e8554f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e85556 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1785787772.501018:0:14283:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1785787772.501020:0:14283:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1785787772.501021:0:14283:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1785787772.501023:0:14283:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1785787772.501024:0:14283:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1785787772.501025:0:14283:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1785787772.501027:0:14283:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1785787772.501028:0:14283:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1785787772.501029:0:14283:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1785787772.501031:0:14283:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1785787772.501034:0:14283:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1785787772.501037:0:14283:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1785787772.501038:0:14283:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1785787772.501039:0:14283:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1785787772.501040:0:14283:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1785787772.501041:0:14283:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1785787772.501042:0:14283:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1785787772.501043:0:14283:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1785787772.501044:0:14283:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1785787772.501045:0:14283:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1785787772.501046:0:14283:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1785787772.501063:0:14283:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1785787772.501077:0:14283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14283:1872533770046464:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1785787772.501117:0:14283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787772.501977:0:14283:0:(client.c:2702:ptlrpc_set_wait()) set ffff91904689bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1785787772.504779:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770046464 00000100:00100000:1.0:1785787772.504801:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770046464 00000100:00100000:0.0:1785787772.509666:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1785787772.509680:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+12:14283:x1872533770046464:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1785787772.509709:0:14296:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1785787772.509723:0:14296:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1785787772.580138:0:14296:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1785787772.580151:0:14296:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1785787772.580171:0:14317:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1785787772.580175:0:14317:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1785787772.580195:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff919052f5f200/0xe2c2ff68a6e8556b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787772.580212:0:14317:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919052f5f400/0xe2c2ff68a6e8553a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e85533 expref: 12 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787772.580220:0:14317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff919052f5f200/0xe2c2ff68a6e8556b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787772.580257:0:14317:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919052f5f400/0xe2c2ff68a6e8553a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2c2ff68a6e85533 expref: 12 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787772.580270:0:14317:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff919052f5f400/0xe2c2ff68a6e8553a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2c2ff68a6e85533 expref: 12 pid: 14294 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787772.580283:0:14317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41390000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14317:1872533770046592:0@lo:104: 00000100:00100000:0.0:1785787772.580342:0:14317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787772.580389:0:14317:0:(client.c:2702:ptlrpc_set_wait()) set ffff91908086dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1785787772.580441:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770046592 00000100:00100000:0.0:1785787772.580448:0:14284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770046592 00000100:00100000:0.0:1785787772.580498:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1785787772.580506:0:14284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41391180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f9a1da20-2955-44fa-b075-f73628199db8+3:14317:x1872533770046592:12345-0@lo:104: 00010000:00010000:0.0:1785787772.580518:0:14284:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff91908206a400/0xe2c2ff68a6e85533 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e8553a expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787772.580565:0:14284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1785787772.580571:0:14284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41391180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f9a1da20-2955-44fa-b075-f73628199db8+3:14317:x1872533770046592:12345-0@lo:104: Request processed in 66us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787772.580578:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1785787772.580615:0:14317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41390000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14317:1872533770046592:0@lo:104: 00010000:00010000:0.0:1785787772.580633:0:14317:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff919052f5f200/0xe2c2ff68a6e8556b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787772.580868:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785787772.580875:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff91908206a400/0xe2c2ff68a6e85533 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e8553a expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787772.580941:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91908206a400 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:1.0:1785787772.580945:0:14290:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff91908206a400/0xe2c2ff68a6e85533 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2c2ff68a6e8553a expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787772.580954:0:14290:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff91908206a400/0xe2c2ff68a6e85533 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2c2ff68a6e8553a expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785787772.580962:0:14290:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff91908206a400/0xe2c2ff68a6e85533 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2c2ff68a6e8553a expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785787772.580967:0:14290:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1785787772.580996:0:14290:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff91908206a400/0xe2c2ff68a6e85533 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e8553a expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787772.581002:0:14290:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785787772.581021:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff91908206a400/0xe2c2ff68a6e85533 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e8553a expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787772.581029:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff91908206a400/0xe2c2ff68a6e85533 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e8553a expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787772.581045:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787772.581047:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787772.581049:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785787772.581076:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9a1da20-2955-44fa-b075-f73628199db8:3336:1872533770046720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785787772.581107:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787772.581173:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770046720 00000100:00100000:1.0:1785787772.581177:0:14286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770046720 00010000:00010000:1.0:1785787772.581195:0:14286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919052f5f400/0xe2c2ff68a6e8553a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e85533 expref: 13 pid: 14294 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787772.581216:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1785787772.581222:0:14286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9a1da20-2955-44fa-b075-f73628199db8+13:3336:x1872533770046720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785787772.581232:0:14286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785787772.581237:0:14286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919052f5f400/0xe2c2ff68a6e8553a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e85533 expref: 13 pid: 14294 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787772.581246:0:14286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919052f5f400/0xe2c2ff68a6e8553a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2c2ff68a6e85533 expref: 13 pid: 14294 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787772.581258:0:14286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919052f5f400/0xe2c2ff68a6e8553a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2c2ff68a6e85533 expref: 13 pid: 14294 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787772.581269:0:14286:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff919052f5f200/0xe2c2ff68a6e8556b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787772.581276:0:14286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919052f5f200/0xe2c2ff68a6e8556b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1785787772.581288:0:14286:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001113365s 00010000:00010000:1.0:1785787772.581292:0:14286:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919052f5f200/0xe2c2ff68a6e8556b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787772.581298:0:14286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919052f5f200/0xe2c2ff68a6e8556b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787772.581305:0:14286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff919052f5f200/0xe2c2ff68a6e8556b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787772.581317:0:14286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff919052f5f200/0xe2c2ff68a6e8556b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787772.581323:0:14286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919052f5f200 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785787772.581326:0:14286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff919052f5f200/0xe2c2ff68a6e8556b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787772.581334:0:14286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff919052f5f200/0xe2c2ff68a6e8556b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787772.581346:0:14286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff919052f5f200/0xe2c2ff68a6e8556b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787772.581355:0:14286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785787772.581381:0:14286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9a1da20-2955-44fa-b075-f73628199db8+12:3336:x1872533770046720:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787772.581387:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1785787772.581411:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9a1da20-2955-44fa-b075-f73628199db8:3336:1872533770046720:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785787772.581425:0:14317:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff919052f5f200/0xe2c2ff68a6e8556b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787772.581431:0:14317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff919052f5f200/0xe2c2ff68a6e8556b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787772.581437:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919052f5f200/0xe2c2ff68a6e8556b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787772.610960:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+11:14283:x1872533770046464:12345-0@lo:253:mount.lustre.0 Request processed in 101276us (109835us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787772.610990:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1785787772.611130:0:14283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14283:1872533770046464:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1785787772.611143:0:14283:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1785787772.611146:0:14283:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1785787772.611148:0:14283:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1785787772.611149:0:14283:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1785787772.611150:0:14283:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1785787772.611151:0:14283:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1785787772.611152:0:14283:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1785787772.611153:0:14283:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1785787772.611155:0:14283:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1785787772.611157:0:14283:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1785787772.611158:0:14283:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1785787772.611171:0:14283:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1785787772.623679:0:14283:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1785787772.625200:0:14283:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1785787772.625665:0:14283:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1785787772.627110:0:14283:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1785787772.627392:0:14283:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1785787772.627542:0:14283:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1785787772.636382:0:14283:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1785787772.636531:0:14283:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1785787772.638342:0:14283:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1785787772.638560:0:14283:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1785787772.640196:0:14283:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1785787772.640339:0:14283:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1785787772.686151:0:14283:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1785787772.691012:0:14283:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1785787772.692319:0:14339:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1785787772.692450:0:14339:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1785787772.694923:0:14283:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1785787772.695047:0:14283:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1785787772.695489:0:14283:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1785787772.695496:0:14283:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1785787772.695607:0:14283:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1785787772.701979:0:14338:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1785787772.701987:0:14338:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:3.0:1785787772.702063:0:14339:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1785787772.702134:0:14339:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1785787772.702139:0:14339:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:2.0:1785787772.703987:0:14283:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1785787772.706032:0:14283:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1785787772.706081:0:14283:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1785787772.708635:0:14283:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1785787772.720991:0:14283:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1785787772.799605:0:14283:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1785787772.799637:0:14283:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb1fe01843988 00100000:10000000:0.0:1785787772.799646:0:14283:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1785787772.801561:0:14283:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1785787772.801575:0:14283:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.153@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1785787772.801586:0:14283:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1785787772.801608:0:14283:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1785787772.917012:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1785787773.494473:0:14333:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1785787773.820258:0:14298:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1785787773.820267:0:14298:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff91905f91f800 from 6 10000000:01000000:0.0:1785787773.820283:0:14298:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1785787773.820325:0:14298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff919052f5e000/0xe2c2ff68a6e85572 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787773.820436:0:14298:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff919052f5e000/0xe2c2ff68a6e85572 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787773.820448:0:14298:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff919052f5e000/0xe2c2ff68a6e85572 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787773.820479:0:14298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41390000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9a1da20-2955-44fa-b075-f73628199db8:14298:1872533770046848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1785787773.820543:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787773.820599:0:14298:0:(client.c:2702:ptlrpc_set_wait()) set ffff91904689b480 going to sleep for 11 seconds 00000100:00100000:2.0:1785787773.821401:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770046848 00000100:00100000:2.0:1785787773.821408:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770046848 00000100:00100000:2.0:1785787773.821452:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1785787773.821462:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+11:14298:x1872533770046848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785787773.821475:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787773.821489:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91904677c400/0xe2c2ff68a6e85579 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e85572 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787773.821511:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91904677c400/0xe2c2ff68a6e85579 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e85572 expref: 12 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787773.821534:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91904677c400/0xe2c2ff68a6e85579 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e85572 expref: 12 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787773.821543:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677c400, rc 0) 00000100:00100000:2.0:1785787773.821643:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+12:14298:x1872533770046848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787773.821650:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1785787773.821799:0:14298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41390000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9a1da20-2955-44fa-b075-f73628199db8:14298:1872533770046848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785787773.821812:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff919052f5e000/0xe2c2ff68a6e85572 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e85579 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787773.821821:0:14298:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff919052f5e000/0xe2c2ff68a6e85572 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e85579 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787773.821898:0:14298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41390000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9a1da20-2955-44fa-b075-f73628199db8:14298:1872533770046976:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1785787773.821929:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787773.821952:0:14298:0:(client.c:2702:ptlrpc_set_wait()) set ffff91904689b480 going to sleep for 11 seconds 00000100:00100000:2.0:1785787773.822855:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770046976 00000100:00100000:2.0:1785787773.822861:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770046976 00000100:00100000:2.0:1785787773.822890:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1785787773.822898:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+12:14298:x1872533770046976:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1785787773.822914:0:14296:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1785787773.822928:0:14296:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1785787773.822935:0:14296:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1785787773.823024:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+12:14298:x1872533770046976:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787773.823031:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1785787773.823079:0:14298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41390000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9a1da20-2955-44fa-b075-f73628199db8:14298:1872533770046976:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1785787773.823119:0:14298:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1785787773.823126:0:14298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff919052f5e000/0xe2c2ff68a6e85572 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e85579 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787773.823134:0:14298:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff919052f5e000/0xe2c2ff68a6e85572 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e85579 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787773.945585:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1785787774.515539:0:14333:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1785787774.963070:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787775.986931:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787777.011171:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785787777.971963:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9a1da20-2955-44fa-b075-f73628199db8:3333:1872533770047104:0@lo:400:kworker.0 00000100:00100000:2.0:1785787777.972045:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787777.972137:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770047104 00000100:00100000:3.0:1785787777.972145:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770047104 00000100:00100000:3.0:1785787777.972189:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1785787777.972207:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+12:3333:x1872533770047104:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1785787777.975018:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1785787777.975026:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1785787777.975028:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1785787777.975031:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1785787777.975033:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1785787777.975036:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1785787777.975040:0:37:0:(import.c:65:import_set_state_nolock()) ffff91907fc8d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1785787777.975049:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff91907fc8d000 using connection 192.168.203.153@tcp/0@lo 00000100:00100000:1.0:1785787777.975080:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91907fd93800 x1872533770047232/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1785787777.975124:0:3332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3332:1872533770047232:0@lo:38:kworker.0 00000100:00100000:1.0:1785787777.975172:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787777.977758:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770047232 00000100:00100000:2.0:1785787777.977771:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770047232 00000100:00100000:2.0:1785787777.977821:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1785787777.977841:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1872533770047232:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1785787777.977866:0:14303:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 565 last 0 00000020:00000080:2.0:1785787777.977906:0:14303:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xe2c2ff68a6e85580 00000004:00100000:2.0:1785787777.977921:0:14303:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1785787777.978077:0:14303:0:(import.c:65:import_set_state_nolock()) ffff91905c499800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1785787777.978148:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3332:x1872533770047232:12345-0@lo:38:kworker.0 Request processed in 318us (2974us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787777.978156:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1785787777.978201:0:3332:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91907fd93800 x1872533770047232/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1785787787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1785787777.978222:0:3332:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1785787777.978229:0:3332:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1785787777.978233:0:3332:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1785787777.978235:0:3332:0:(import.c:65:import_set_state_nolock()) ffff91907fc8d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1785787777.978242:0:3332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3332:1872533770047232:0@lo:38:kworker.0 00000100:00100000:3.0:1785787777.978390:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+12:3333:x1872533770047104:12345-0@lo:400:kworker.0 Request processed in 6182us (6342us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787777.978399:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1785787777.986887:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9a1da20-2955-44fa-b075-f73628199db8:3333:1872533770047104:0@lo:400:kworker.0 00010000:00010000:1.0:1785787778.034975:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1785787778.481037:0:14582:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg353-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1785787779.061771:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787780.083899:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787781.106950:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1785787781.863285:0:14733:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffee8e13590 20000000:00000080:1.0:1785787781.863301:0:14733:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91905d412000 uarg=0000000000000000 20000000:01000000:1.0:1785787781.863330:0:14733:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1785787781.863336:0:14733:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1785787781.863341:0:14733:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1785787781.864586:0:14734:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1785787781.864721:0:14733:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1785787781.876255:0:14733:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1785787781.876282:0:14733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91905f903800/0xe2c2ff68a6e85587 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787781.876298:0:14733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919052f5fa00/0xe2c2ff68a6e85548 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e85541 expref: 11 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787781.876306:0:14733:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91905f903800/0xe2c2ff68a6e85587 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787781.876340:0:14733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919052f5fa00/0xe2c2ff68a6e85548 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2c2ff68a6e85541 expref: 11 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787781.876354:0:14733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff919052f5fa00/0xe2c2ff68a6e85548 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2c2ff68a6e85541 expref: 11 pid: 14294 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787781.876377:0:14733:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076d89880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14733:1872533770047360:0@lo:104: 00000100:00100000:3.0:1785787781.876431:0:14733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787781.876520:0:14733:0:(client.c:2702:ptlrpc_set_wait()) set ffff91907bb28240 going to sleep for 11 seconds 00000100:00100000:0.0:1785787781.876646:0:14285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770047360 00000100:00100000:0.0:1785787781.876664:0:14285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770047360 00000100:00100000:0.0:1785787781.876714:0:14285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1785787781.876722:0:14285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076d88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9a1da20-2955-44fa-b075-f73628199db8+3:14733:x1872533770047360:12345-0@lo:104: 00010000:00010000:0.0:1785787781.876734:0:14285:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff91904677d200/0xe2c2ff68a6e85541 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e85548 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787781.876962:0:14285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1785787781.876968:0:14285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076d88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9a1da20-2955-44fa-b075-f73628199db8+3:14733:x1872533770047360:12345-0@lo:104: Request processed in 247us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787781.876974:0:14285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1785787781.877231:0:14733:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076d89880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14733:1872533770047360:0@lo:104: 00010000:00010000:3.0:1785787781.877247:0:14733:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91905f903800/0xe2c2ff68a6e85587 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787781.878162:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785787781.878169:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff91904677d200/0xe2c2ff68a6e85541 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e85548 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787781.878185:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677d200 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:2.0:1785787781.878189:0:14290:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff91904677d200/0xe2c2ff68a6e85541 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2c2ff68a6e85548 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787781.878198:0:14290:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff91904677d200/0xe2c2ff68a6e85541 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2c2ff68a6e85548 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785787781.878217:0:14290:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff91904677d200/0xe2c2ff68a6e85541 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2c2ff68a6e85548 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785787781.878222:0:14290:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1785787781.878262:0:14290:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff91904677d200/0xe2c2ff68a6e85541 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e85548 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787781.878283:0:14290:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785787781.878300:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff91904677d200/0xe2c2ff68a6e85541 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e85548 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787781.878321:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff91904677d200/0xe2c2ff68a6e85541 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e85548 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787781.878334:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787781.878336:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787781.878337:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785787781.878347:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9a1da20-2955-44fa-b075-f73628199db8:3334:1872533770047488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785787781.878389:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787781.878437:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770047488 00000100:00100000:2.0:1785787781.878452:0:14286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770047488 00010000:00010000:2.0:1785787781.878472:0:14286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919052f5fa00/0xe2c2ff68a6e85548 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e85541 expref: 12 pid: 14294 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787781.878496:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1785787781.878503:0:14286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9a1da20-2955-44fa-b075-f73628199db8+12:3334:x1872533770047488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785787781.878513:0:14286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785787781.878518:0:14286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919052f5fa00/0xe2c2ff68a6e85548 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e85541 expref: 12 pid: 14294 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787781.878534:0:14286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919052f5fa00/0xe2c2ff68a6e85548 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2c2ff68a6e85541 expref: 12 pid: 14294 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787781.878547:0:14286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919052f5fa00/0xe2c2ff68a6e85548 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2c2ff68a6e85541 expref: 12 pid: 14294 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787781.878559:0:14286:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91905f903800/0xe2c2ff68a6e85587 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787781.878567:0:14286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91905f903800/0xe2c2ff68a6e85587 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787781.878577:0:14286:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91905f903800/0xe2c2ff68a6e85587 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787781.878594:0:14286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91905f903800/0xe2c2ff68a6e85587 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787781.878599:0:14286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91905f903800/0xe2c2ff68a6e85587 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787781.878604:0:14286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91905f903800/0xe2c2ff68a6e85587 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787781.878608:0:14286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903800 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785787781.878611:0:14286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91905f903800/0xe2c2ff68a6e85587 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787781.878617:0:14286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91905f903800/0xe2c2ff68a6e85587 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787781.878649:0:14286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91905f903800/0xe2c2ff68a6e85587 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787781.878657:0:14286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785787781.878682:0:14286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9a1da20-2955-44fa-b075-f73628199db8+11:3334:x1872533770047488:12345-0@lo:103:ldlm_bl.0 Request processed in 180us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787781.878688:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1785787781.878713:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9a1da20-2955-44fa-b075-f73628199db8:3334:1872533770047488:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785787781.879463:0:14733:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91905f903800/0xe2c2ff68a6e85587 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787781.879478:0:14733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91905f903800/0xe2c2ff68a6e85587 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787781.879485:0:14733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91905f903800/0xe2c2ff68a6e85587 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787782.077338:0:3332:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1785787772/real 1785787772] req@ffff91907764ed80 x1872533770044544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1785787782 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787782.077366:0:3332:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91907764ed80 x1872533770044544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1785787782 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787782.082034:0:3332:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1785787772/real 1785787772] req@ffff91907764ca80 x1872533770044416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1785787782 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787782.082062:0:3332:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91907764ca80 x1872533770044416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1785787782 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1785787782.082079:0:3332:0:(import.c:65:import_set_state_nolock()) ffff91905fad9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1785787782.082101:0:3332:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1785787782.082105:0:3332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3332:1872533770044544:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1785787782.082111:0:3332:0:(import.c:65:import_set_state_nolock()) ffff919077066800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1785787782.082116:0:3332:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1785787782.082119:0:3332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3332:1872533770044416:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1785787782.082180:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1785787782.082185:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1785787782.082188:0:37:0:(import.c:65:import_set_state_nolock()) ffff919077066800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1785787782.082192:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 559 00000100:00080000:2.0:1785787782.082197:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1785787782.082202:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff919077066800 using connection 192.168.203.153@tcp/0@lo 00000100:00100000:2.0:1785787782.082230:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91907764e300 x1872533770047616/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1785787782.082253:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1785787782.082256:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1785787782.082258:0:37:0:(import.c:65:import_set_state_nolock()) ffff91905fad9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1785787782.082261:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 559 00000100:00080000:2.0:1785787782.082269:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1785787782.082272:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91905fad9800 using connection 192.168.203.153@tcp/0@lo 00000100:00100000:2.0:1785787782.082283:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91907764c700 x1872533770047744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785787782.082354:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3335:1872533770047872:0@lo:400:kworker.0 00000100:00100000:3.0:1785787782.082429:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787782.082539:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770047872 00000100:00100000:2.0:1785787782.082545:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770047872 00000100:00100000:2.0:1785787782.082594:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1785787782.082602:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076d89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3335:x1872533770047872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787782.082661:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076d89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3335:x1872533770047872:12345-0@lo:400:kworker.0 Request processed in 60us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787782.082668:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1785787782.082847:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91907764fb80 x1872533770047872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787782.082860:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3335:1872533770047872:0@lo:400:kworker.0 00000100:00100000:0.0:1785787782.082911:0:3332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3332:1872533770047616:0@lo:8:kworker.0 00000400:00000100:0.0:1785787782.082936:0:3332:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1872533770047616 offset 0 length 520: 4 00000100:00100000:0.0:1785787782.082954:0:3332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3332:1872533770047744:0@lo:8:kworker.0 00000400:00000100:0.0:1785787782.082968:0:3332:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1872533770047744 offset 0 length 520: 4 00010000:00010000:2.0:1785787782.131943:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787783.155191:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1785787783.157354:0:14298:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1785787783.157359:0:14298:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff91905f91f800 from 10 10000000:01000000:0.0:1785787783.157363:0:14298:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1785787783.157407:0:14298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff919052f5fc00/0xe2c2ff68a6e8558e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787783.157419:0:14298:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff919052f5fc00/0xe2c2ff68a6e8558e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787783.157430:0:14298:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff919052f5fc00/0xe2c2ff68a6e8558e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787783.157455:0:14298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41390000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9a1da20-2955-44fa-b075-f73628199db8:14298:1872533770048000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1785787783.157518:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787783.157566:0:14298:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190463dd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785787783.157781:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770048000 00000100:00100000:2.0:1785787783.157789:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770048000 00000100:00100000:2.0:1785787783.157856:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1785787783.157866:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+11:14298:x1872533770048000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785787783.157877:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787783.157889:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91904677de00/0xe2c2ff68a6e85595 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e8558e expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787783.157911:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91904677de00/0xe2c2ff68a6e85595 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e8558e expref: 12 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787783.157921:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91904677de00/0xe2c2ff68a6e85595 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e8558e expref: 12 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787783.157930:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677de00, rc 0) 00000100:00100000:2.0:1785787783.157977:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+12:14298:x1872533770048000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787783.157983:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1785787783.158022:0:14298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41390000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9a1da20-2955-44fa-b075-f73628199db8:14298:1872533770048000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785787783.158053:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff919052f5fc00/0xe2c2ff68a6e8558e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e85595 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787783.158062:0:14298:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff919052f5fc00/0xe2c2ff68a6e8558e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e85595 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787783.158109:0:14298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9a1da20-2955-44fa-b075-f73628199db8:14298:1872533770048128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1785787783.158131:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787783.158143:0:14298:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905c4c2780 going to sleep for 11 seconds 00000100:00100000:0.0:1785787783.158412:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770048128 00000100:00100000:0.0:1785787783.158417:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770048128 00000100:00100000:0.0:1785787783.158446:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1785787783.158453:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+12:14298:x1872533770048128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785787783.158675:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+12:14298:x1872533770048128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 222us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787783.158683:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1785787783.160936:0:14298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9a1da20-2955-44fa-b075-f73628199db8:14298:1872533770048128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1785787783.160989:0:14298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9a1da20-2955-44fa-b075-f73628199db8:14298:1872533770048256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1785787783.161053:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787783.161089:0:14298:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905c4c2780 going to sleep for 11 seconds 00000100:00100000:3.0:1785787783.161183:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770048256 00000100:00100000:3.0:1785787783.161188:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770048256 00000100:00100000:3.0:1785787783.161228:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1785787783.161236:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+12:14298:x1872533770048256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785787783.161399:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+12:14298:x1872533770048256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787783.161407:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1785787783.161451:0:14298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9a1da20-2955-44fa-b075-f73628199db8:14298:1872533770048256:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1785787783.162574:0:14768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1785787783.162633:0:14298:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1785787783.162647:0:14298:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1785787783.162656:0:14298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff919052f5fc00/0xe2c2ff68a6e8558e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e85595 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787783.162678:0:14298:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff919052f5fc00/0xe2c2ff68a6e8558e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e85595 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787784.182435:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1785787784.759443:0:14333:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1785787785.203888:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787786.231902:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1785787787.192392:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1785787787.192398:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1785787787.192401:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1785787787.192404:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1785787787.192435:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785787787.192453:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9a1da20-2955-44fa-b075-f73628199db8:3335:1872533770048384:0@lo:400:kworker.0 00000100:00100000:2.0:1785787787.192525:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787787.192580:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1872533770048512:0@lo:400:kworker.0 00000100:00100000:2.0:1785787787.192615:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787787.192651:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770048384 00000100:00100000:2.0:1785787787.192657:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770048384 00000100:00100000:2.0:1785787787.192694:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1785787787.192702:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+12:3335:x1872533770048384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787787.192759:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+12:3335:x1872533770048384:12345-0@lo:400:kworker.0 Request processed in 57us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787787.192766:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1785787787.192819:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9a1da20-2955-44fa-b075-f73628199db8:3335:1872533770048384:0@lo:400:kworker.0 00000100:00100000:1.0:1785787787.202103:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770048512 00000100:00100000:1.0:1785787787.202116:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770048512 00000100:00100000:1.0:1785787787.202161:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1785787787.202171:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1872533770048512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787787.202267:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1872533770048512:12345-0@lo:400:kworker.0 Request processed in 98us (9651us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787787.202275:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1785787787.202318:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91907764df80 x1872533770048512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787787.202333:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1872533770048512:0@lo:400:kworker.0 00010000:00010000:1.0:1785787787.252863:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1785787787.851641:0:14935:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1785787787.851644:0:14935:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1785787787.853113:0:14935:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff91904e8a5800 00000020:01000004:3.0:1785787787.853130:0:14935:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1785787787.853142:0:14935:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1785787787.853154:0:14935:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9190507f19c0) 00000020:00000080:3.0:1785787787.853168:0:14935:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1785787787.918427:0:14935:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1785787787.918743:0:14935:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1785787787.920242:0:14935:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1785787787.920462:0:14935:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1785787787.920686:0:14935:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1785787787.921086:0:14935:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:3.0:1785787787.921178:0:14935:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:3.0:1785787787.921274:0:14935:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:3.0:1785787787.922666:0:14935:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 301: rc = 0 00100000:10000000:3.0:1785787787.923420:0:14935:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 301: rc = 0 00100000:10000000:2.0:1785787787.935034:0:14935:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 301: rc = 0 00100000:10000000:2.0:1785787787.935309:0:14935:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 301: rc = 0 00100000:10000000:2.0:1785787787.937207:0:14935:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 301: rc = 0 00100000:10000000:2.0:1785787787.938236:0:14935:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 301: rc = 0 00000020:00000080:2.0:1785787787.938933:0:14935:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1785787787.938944:0:14935:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1785787787.938954:0:14935:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe2c2ff68a6e855a3 00000020:01000004:2.0:1785787787.938961:0:14935:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1785787787.938981:0:14935:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.153@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1785787787.938984:0:14935:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1785787787.938989:0:14935:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1785787787.938993:0:14935:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1785787787.939003:0:14935:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff91905c493380) 00000020:00000080:2.0:1785787787.939012:0:14935:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1785787787.942315:0:14935:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1785787787.942453:0:14935:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1785787787.942463:0:14935:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1785787787.949978:0:14935:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1785787787.949993:0:14935:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1785787787.951325:0:14935:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1785787787.951333:0:14935:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1785787787.954944:0:14935:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1785787787.955104:0:14935:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1785787787.955110:0:14935:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1785787787.964440:0:14935:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1785787787.964457:0:14935:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1785787788.007363:0:14935:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1785787788.008162:0:14935:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1785787788.008688:0:14935:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1785787788.010458:0:14935:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1785787788.010685:0:14935:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1785787788.018179:0:14935:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1785787788.018197:0:14935:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1785787788.024559:0:14935:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1785787788.025113:0:14935:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1785787788.025119:0:14935:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1785787788.026715:0:14935:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1785787788.026724:0:14935:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1785787788.084850:0:14935:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1785787788.085721:0:14935:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1785787788.085737:0:14935:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1785787788.087323:0:14935:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1785787788.087331:0:14935:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1785787788.088717:0:14935:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1785787788.088749:0:14935:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1785787788.088755:0:14935:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.153@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1785787788.113754:0:14935:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.153@tcp ctxt 0 is initialized 00000020:01000004:1.0:1785787788.113796:0:14935:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.153@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1785787788.113800:0:14935:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1785787788.113802:0:14935:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1785787788.113803:0:14935:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785787788.113804:0:14935:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1785787788.113805:0:14935:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785787788.113806:0:14935:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785787788.113808:0:14935:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1785787788.113810:0:14935:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785787788.113811:0:14935:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1785787788.113815:0:14935:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1785787788.113817:0:14935:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1785787788.113818:0:14935:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1785787788.113819:0:14935:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785787788.113821:0:14935:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1785787788.113822:0:14935:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785787788.113823:0:14935:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785787788.113823:0:14935:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1785787788.113824:0:14935:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785787788.113825:0:14935:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1785787788.114031:0:14935:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1785787788.114052:0:14935:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd91180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14935:1872533770048640:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1785787788.114129:0:14935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787788.114340:0:14935:0:(client.c:2702:ptlrpc_set_wait()) set ffff919044efa3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785787788.114385:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770048640 00000100:00100000:2.0:1785787788.114392:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770048640 00000100:00100000:2.0:1785787788.114489:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1785787788.114498:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+12:14935:x1872533770048640:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1785787788.114536:0:14295:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1785787788.114540:0:14295:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1785787788.114543:0:14295:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1785787788.151640:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+12:14935:x1872533770048640:12345-0@lo:253:mount.lustre.0 Request processed in 37135us (37503us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787788.151654:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1785787788.151787:0:14935:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd91180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14935:1872533770048640:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1785787788.151801:0:14935:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1785787788.151805:0:14935:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1785787788.151813:0:14935:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1785787788.151814:0:14935:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785787788.151815:0:14935:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1785787788.151816:0:14935:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785787788.151818:0:14935:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785787788.151819:0:14935:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1785787788.151821:0:14935:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785787788.151822:0:14935:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1785787788.151859:0:14935:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91904e8a5800 from lustre-OST0000 10000000:01000000:1.0:1785787788.151892:0:14935:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1785787788.151895:0:14935:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1785787788.151901:0:14935:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9190507f3380 local copy 00010000:00010000:1.0:1785787788.151912:0:14935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff91908206b600/0xe2c2ff68a6e85499 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e854a0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787788.152127:0:14935:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd91180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14935:1872533770048768:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1785787788.152159:0:14935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787788.152204:0:14935:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190558fc900 going to sleep for 11 seconds 00000100:00100000:2.0:1785787788.152636:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770048768 00000100:00100000:2.0:1785787788.152643:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770048768 00000100:00100000:2.0:1785787788.152680:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1785787788.152688:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+12:14935:x1872533770048768:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785787788.152878:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+12:14935:x1872533770048768:12345-0@lo:501:mount.lustre.0 Request processed in 190us (717us total) trans 0 rc -2/-2 00000100:00100000:2.0:1785787788.152886:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1785787788.153210:0:14935:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd91180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14935:1872533770048768:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1785787788.153223:0:14935:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1785787788.153381:0:14935:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1785787788.153389:0:14935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff91908206b600/0xe2c2ff68a6e85499 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e854a0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787788.153398:0:14935:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff91908206b600/0xe2c2ff68a6e85499 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e854a0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785787788.153434:0:14935:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91904e8a5800 10000000:01000000:1.0:1785787788.153439:0:14935:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1785787788.153444:0:14935:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9190507f3380 10000000:01000000:1.0:1785787788.153447:0:14935:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1785787788.153451:0:14935:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9190507f3380 from 1 10000000:01000000:1.0:1785787788.153454:0:14935:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1785787788.153477:0:14935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff91908206a000/0xe2c2ff68a6e855b1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787788.153485:0:14935:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff91908206a000/0xe2c2ff68a6e855b1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787788.153495:0:14935:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff91908206a000/0xe2c2ff68a6e855b1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787788.153522:0:14935:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd91180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14935:1872533770048896:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1785787788.153551:0:14935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787788.153580:0:14935:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190558fc900 going to sleep for 11 seconds 00000100:00100000:2.0:1785787788.154126:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770048896 00000100:00100000:2.0:1785787788.154132:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770048896 00000100:00100000:2.0:1785787788.154177:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1785787788.154185:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+12:14935:x1872533770048896:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1785787788.154205:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787788.154219:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91904677c000/0xe2c2ff68a6e855b8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e855b1 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787788.154249:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91904677c000/0xe2c2ff68a6e855b8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e855b1 expref: 13 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787788.154261:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91904677c000/0xe2c2ff68a6e855b8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e855b1 expref: 13 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787788.154270:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677c000, rc 0) 00000100:00100000:2.0:1785787788.154310:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+13:14935:x1872533770048896:12345-0@lo:101:mount.lustre.0 Request processed in 126us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787788.154316:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1785787788.155016:0:14935:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd91180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14935:1872533770048896:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1785787788.155037:0:14935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff91908206a000/0xe2c2ff68a6e855b1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e855b8 expref: -99 pid: 14935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787788.155046:0:14935:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff91908206a000/0xe2c2ff68a6e855b1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e855b8 expref: -99 pid: 14935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785787788.155060:0:14935:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1785787788.155074:0:14935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff91908206a000/0xe2c2ff68a6e855b1 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e855b8 expref: -99 pid: 14935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787788.155091:0:14935:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff91908206a000/0xe2c2ff68a6e855b1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e855b8 expref: -99 pid: 14935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785787788.155099:0:14935:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1785787788.155104:0:14935:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1785787788.155109:0:14935:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1785787788.155111:0:14935:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1785787788.155128:0:14935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff91908206b000/0xe2c2ff68a6e855bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787788.155135:0:14935:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff91908206b000/0xe2c2ff68a6e855bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787788.155142:0:14935:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff91908206b000/0xe2c2ff68a6e855bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787788.155156:0:14935:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd91180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14935:1872533770049024:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1785787788.155191:0:14935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787788.155219:0:14935:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190558fc900 going to sleep for 11 seconds 00000100:00100000:0.0:1785787788.155316:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770049024 00000100:00100000:0.0:1785787788.155322:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770049024 00000100:00100000:0.0:1785787788.155352:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1785787788.155358:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+13:14935:x1872533770049024:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1785787788.155366:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787788.155374:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919052f5f400/0xe2c2ff68a6e855c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e855bf expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787788.155390:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919052f5f400/0xe2c2ff68a6e855c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e855bf expref: 14 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787788.155398:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919052f5f400/0xe2c2ff68a6e855c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e855bf expref: 14 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787788.155404:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919052f5f400, rc 0) 00000100:00100000:0.0:1785787788.155435:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+14:14935:x1872533770049024:12345-0@lo:101:mount.lustre.0 Request processed in 77us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787788.155441:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1785787788.155779:0:14935:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd91180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14935:1872533770049024:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1785787788.155790:0:14935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff91908206b000/0xe2c2ff68a6e855bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e855c6 expref: -99 pid: 14935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787788.155798:0:14935:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff91908206b000/0xe2c2ff68a6e855bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e855c6 expref: -99 pid: 14935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1785787788.157355:0:14935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1785787788.162747:0:14935:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1785787788.164378:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1785787788.164434:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1785787788.166765:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1785787788.167185:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1785787788.167226:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1785787788.167588:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1785787788.167740:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1785787788.167749:0:14935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1785787788.168588:0:14935:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd91180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14935:1872533770049152:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1785787788.168707:0:14935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787788.168819:0:14935:0:(client.c:2702:ptlrpc_set_wait()) set ffff919044efa3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785787788.172767:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770049152 00000100:00100000:3.0:1785787788.174183:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770049152 00000100:00100000:3.0:1785787788.174246:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1785787788.174256:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077638850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+14:14935:x1872533770049152:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1785787788.174689:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077638850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+14:14935:x1872533770049152:12345-0@lo:501:mount.lustre.0 Request processed in 434us (5981us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787788.174697:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1785787788.175108:0:14935:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd91180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14935:1872533770049152:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1785787788.175159:0:14935:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd91180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14935:1872533770049280:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1785787788.175218:0:14935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787788.175264:0:14935:0:(client.c:2702:ptlrpc_set_wait()) set ffff919044efa3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785787788.175409:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770049280 00000100:00100000:2.0:1785787788.175414:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770049280 00000100:00100000:2.0:1785787788.175452:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1785787788.175461:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077638450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+14:14935:x1872533770049280:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1785787788.175799:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077638450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+14:14935:x1872533770049280:12345-0@lo:503:mount.lustre.0 Request processed in 339us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787788.175807:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1785787788.176373:0:14935:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd91180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14935:1872533770049280:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1785787788.177359:0:14935:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1785787788.177423:0:14935:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd91180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14935:1872533770049408:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1785787788.177471:0:14935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787788.177508:0:14935:0:(client.c:2702:ptlrpc_set_wait()) set ffff919044efa3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785787788.177606:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770049408 00000100:00100000:0.0:1785787788.177613:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770049408 00000100:00100000:0.0:1785787788.177654:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1785787788.177662:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+14:14935:x1872533770049408:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1785787788.177921:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+14:14935:x1872533770049408:12345-0@lo:502:mount.lustre.0 Request processed in 259us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787788.177950:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1785787788.178396:0:14935:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd91180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14935:1872533770049408:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1785787788.180682:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1785787788.180777:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1785787788.180815:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1785787788.180907:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1785787788.181625:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1785787788.181669:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1785787788.181722:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1785787788.181767:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1785787788.181852:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1785787788.182098:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1785787788.182142:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1785787788.182211:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1785787788.182353:0:14935:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076d89f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14935:1872533770049536:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1785787788.182421:0:14935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787788.182464:0:14935:0:(client.c:2702:ptlrpc_set_wait()) set ffff91906e756c00 going to sleep for 11 seconds 00000100:00100000:0.0:1785787788.183072:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770049536 00000100:00100000:0.0:1785787788.183079:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770049536 00000100:00100000:0.0:1785787788.183125:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1785787788.183133:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+14:14935:x1872533770049536:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1785787788.183332:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+14:14935:x1872533770049536:12345-0@lo:502:mount.lustre.0 Request processed in 198us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787788.183340:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1785787788.183619:0:14935:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076d89f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14935:1872533770049536:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1785787788.183706:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1785787788.183724:0:14935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1785787788.185299:0:14949:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1785787788.185307:0:14949:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1785787788.185312:0:14949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785787788.185315:0:14949:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1785787788.185320:0:14949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1785787788.185333:0:14949:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9190515c99c0) 00000020:00000080:0.0:1785787788.185351:0:14949:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1785787788.185355:0:14949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1785787788.185416:0:14949:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91904e8a5800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1785787788.185423:0:14949:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1785787788.185431:0:14949:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe2c2ff68a6e855d4 00010000:00010000:2.0:1785787788.200684:0:14949:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1785787788.202110:0:14949:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1785787788.207785:0:14949:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1785787788.217176:0:14949:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1785787788.217187:0:14949:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785787788.217193:0:14949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785787788.217195:0:14949:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1785787788.217198:0:14949:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1785787788.217201:0:14949:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1785787788.217202:0:14949:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1785787788.217203:0:14949:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1785787788.217205:0:14949:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1785787788.217207:0:14949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785787788.217219:0:14949:0:(obd_config.c:1561:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1785787788.217222:0:14949:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785787788.217225:0:14949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785787788.217227:0:14949:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1785787788.217229:0:14949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1785787788.217231:0:14949:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1785787788.217233:0:14949:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785787788.217235:0:14949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785787788.217236:0:14949:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1785787788.217238:0:14949:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785787788.217251:0:14949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785787788.217252:0:14949:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1785787788.217256:0:14949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1785787788.217314:0:14949:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785787788.217317:0:14949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785787788.217319:0:14949:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1785787788.217322:0:14949:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1785787788.219551:0:14935:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1785787788.219584:0:14935:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1785787788.219614:0:14935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff91908206b000/0xe2c2ff68a6e855bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e855c6 expref: -99 pid: 14935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787788.219626:0:14935:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff91908206b000/0xe2c2ff68a6e855bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e855c6 expref: -99 pid: 14935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785787788.219634:0:14935:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff91904e8a5800 from 1 10000000:01000000:3.0:1785787788.219637:0:14935:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1785787788.219673:0:14935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e855db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787788.219692:0:14935:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e855db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787788.219703:0:14935:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e855db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787788.219735:0:14935:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076d8a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14935:1872533770049664:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1785787788.220345:0:14935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787788.220392:0:14935:0:(client.c:2702:ptlrpc_set_wait()) set ffff91906e7566c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785787788.222892:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770049664 00000100:00100000:0.0:1785787788.222906:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770049664 00000100:00100000:1.0:1785787788.223205:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1785787788.223217:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+14:14935:x1872533770049664:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1785787788.223232:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787788.223260:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91908206be00/0xe2c2ff68a6e855e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e855db expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787788.223287:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91908206be00/0xe2c2ff68a6e855e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e855db expref: 15 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787788.223298:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91908206be00/0xe2c2ff68a6e855e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e855db expref: 15 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787788.223307:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91908206be00, rc 0) 00000100:00100000:1.0:1785787788.223385:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+15:14935:x1872533770049664:12345-0@lo:101:mount.lustre.0 Request processed in 172us (3041us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787788.223392:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1785787788.223977:0:14935:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076d8a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14935:1872533770049664:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1785787788.223995:0:14935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e855db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e855e2 expref: -99 pid: 14935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787788.224005:0:14935:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e855db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e855e2 expref: -99 pid: 14935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1785787788.227083:0:14935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1785787788.233669:0:14935:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1785787788.234815:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1785787788.236604:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1785787788.236693:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1785787788.236701:0:14935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1785787788.236810:0:14935:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076d8a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14935:1872533770049792:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1785787788.238607:0:14935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787788.238652:0:14935:0:(client.c:2702:ptlrpc_set_wait()) set ffff91906e7566c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785787788.238963:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770049792 00000100:00100000:2.0:1785787788.238971:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770049792 00000100:00100000:2.0:1785787788.239018:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1785787788.239039:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077639050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+15:14935:x1872533770049792:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785787788.243330:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077639050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+15:14935:x1872533770049792:12345-0@lo:501:mount.lustre.0 Request processed in 4296us (4729us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787788.243355:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1785787788.245507:0:14935:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076d8a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14935:1872533770049792:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1785787788.245561:0:14935:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076d8a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14935:1872533770049920:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1785787788.245631:0:14935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787788.245668:0:14935:0:(client.c:2702:ptlrpc_set_wait()) set ffff91906e7566c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785787788.245714:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770049920 00000100:00100000:0.0:1785787788.245721:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770049920 00000100:00100000:0.0:1785787788.245782:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1785787788.245792:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077638050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+15:14935:x1872533770049920:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1785787788.245995:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077638050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+15:14935:x1872533770049920:12345-0@lo:503:mount.lustre.0 Request processed in 205us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787788.246003:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1785787788.246399:0:14935:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076d8a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14935:1872533770049920:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1785787788.247159:0:14935:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1785787788.247216:0:14935:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076d8a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14935:1872533770050048:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1785787788.247264:0:14935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787788.247289:0:14935:0:(client.c:2702:ptlrpc_set_wait()) set ffff91906e7566c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785787788.247410:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770050048 00000100:00100000:0.0:1785787788.247415:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770050048 00000100:00100000:0.0:1785787788.247442:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1785787788.247449:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+15:14935:x1872533770050048:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1785787788.247601:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+15:14935:x1872533770050048:12345-0@lo:502:mount.lustre.0 Request processed in 152us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787788.247615:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1785787788.249228:0:14935:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076d8a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14935:1872533770050048:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1785787788.249499:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1785787788.249551:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1785787788.249869:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1785787788.250224:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1785787788.250281:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1785787788.250337:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1785787788.250372:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1785787788.250403:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1785787788.250435:0:14935:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14935:1872533770050176:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1785787788.250499:0:14935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787788.250537:0:14935:0:(client.c:2702:ptlrpc_set_wait()) set ffff919077106540 going to sleep for 11 seconds 00000100:00100000:3.0:1785787788.252560:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770050176 00000100:00100000:3.0:1785787788.252570:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770050176 00000100:00100000:3.0:1785787788.252632:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1785787788.252641:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+15:14935:x1872533770050176:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1785787788.252909:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+15:14935:x1872533770050176:12345-0@lo:502:mount.lustre.0 Request processed in 269us (2409us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787788.252918:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1785787788.253311:0:14935:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14935:1872533770050176:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1785787788.253430:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1785787788.253446:0:14935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1785787788.257249:0:14953:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1785787788.257260:0:14953:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785787788.257263:0:14953:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1785787788.257269:0:14953:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff91904e8a5800 00000020:00000080:3.0:1785787788.257272:0:14953:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1785787788.257279:0:14953:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785787788.257281:0:14953:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785787788.257283:0:14953:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1785787788.257285:0:14953:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1785787788.257288:0:14953:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785787788.257295:0:14953:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1785787788.257300:0:14953:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff91904e8a5800 00000020:00000080:3.0:1785787788.257302:0:14953:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1785787788.257357:0:14953:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785787788.257360:0:14953:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785787788.257362:0:14953:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1785787788.257364:0:14953:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1785787788.257367:0:14953:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785787788.257369:0:14953:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1785787788.257372:0:14953:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91904e8a5800 00000020:00000080:3.0:1785787788.257374:0:14953:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1785787788.257411:0:14953:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785787788.257414:0:14953:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785787788.257416:0:14953:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1785787788.257419:0:14953:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1785787788.259482:0:14935:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1785787788.259516:0:14935:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1785787788.259537:0:14935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e855db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e855e2 expref: -99 pid: 14935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787788.259549:0:14935:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e855db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e855e2 expref: -99 pid: 14935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785787788.259587:0:14935:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1785787788.259692:0:14935:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91904e8a5800 10000000:01000000:1.0:1785787788.259695:0:14935:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91904e8a5800 10000000:01000000:1.0:1785787788.259699:0:14935:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1785787788.259704:0:14935:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91904e8a5800 from 1 10000000:01000000:1.0:1785787788.259707:0:14935:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1785787788.259747:0:14935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff91908206b400/0xe2c2ff68a6e855e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787788.259757:0:14935:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff91908206b400/0xe2c2ff68a6e855e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787788.259766:0:14935:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff91908206b400/0xe2c2ff68a6e855e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787788.259798:0:14935:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd91180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14935:1872533770050304:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1785787788.260020:0:14935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787788.260203:0:14935:0:(client.c:2702:ptlrpc_set_wait()) set ffff919044efa780 going to sleep for 11 seconds 00000100:00100000:3.0:1785787788.261114:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770050304 00000100:00100000:3.0:1785787788.261123:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770050304 00000100:00100000:3.0:1785787788.261170:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1785787788.261178:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+15:14935:x1872533770050304:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1785787788.261191:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787788.261205:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91905f903e00/0xe2c2ff68a6e855f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e855e9 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787788.261226:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91905f903e00/0xe2c2ff68a6e855f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e855e9 expref: 16 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787788.261236:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91905f903e00/0xe2c2ff68a6e855f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e855e9 expref: 16 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787788.261254:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f903e00, rc 0) 00000100:00100000:3.0:1785787788.261297:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+16:14935:x1872533770050304:12345-0@lo:101:mount.lustre.0 Request processed in 120us (1277us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787788.261310:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1785787788.261963:0:14935:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd91180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14935:1872533770050304:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1785787788.261981:0:14935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff91908206b400/0xe2c2ff68a6e855e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e855f0 expref: -99 pid: 14935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787788.261991:0:14935:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff91908206b400/0xe2c2ff68a6e855e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e855f0 expref: -99 pid: 14935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1785787788.262541:0:14935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1785787788.265646:0:14935:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1785787788.267208:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1785787788.268209:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1785787788.268858:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1785787788.269162:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1785787788.269206:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1785787788.269990:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1785787788.270314:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1785787788.270356:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1785787788.270422:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1785787788.270459:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1785787788.271161:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1785787788.271214:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1785787788.274159:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1785787788.274228:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1785787788.275239:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1785787788.275288:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1785787788.275317:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1785787788.275357:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1785787788.275389:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1785787788.275424:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1785787788.275485:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1785787788.275524:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1785787788.275561:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1785787788.275625:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1785787788.275680:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1785787788.275718:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1785787788.275786:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1785787788.275820:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1785787788.275934:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1785787788.275952:0:14935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1785787788.282069:0:14935:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41390380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14935:1872533770050432:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1785787788.282136:0:14935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787788.282171:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770050432 00000100:00100000:0.0:1785787788.282178:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770050432 00000100:00100000:0.0:1785787788.282222:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1785787788.282229:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+16:14935:x1872533770050432:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1785787788.282470:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+16:14935:x1872533770050432:12345-0@lo:501:mount.lustre.0 Request processed in 240us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787788.285690:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1785787788.285768:0:14935:0:(client.c:2702:ptlrpc_set_wait()) set ffff91907fe400c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785787788.285804:0:14935:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41390380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14935:1872533770050432:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1785787788.285878:0:14935:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41390380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14935:1872533770050560:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1785787788.286115:0:14935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787788.286149:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770050560 00000100:00100000:0.0:1785787788.286154:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770050560 00000100:00100000:0.0:1785787788.286184:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1785787788.286190:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077638c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+16:14935:x1872533770050560:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1785787788.286352:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077638c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+16:14935:x1872533770050560:12345-0@lo:503:mount.lustre.0 Request processed in 161us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787788.286359:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1785787788.286406:0:14935:0:(client.c:2702:ptlrpc_set_wait()) set ffff91907fe400c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785787788.286419:0:14935:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41390380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14935:1872533770050560:0@lo:503:mount.lustre.0 00010000:00010000:1.0:1785787788.289104:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1785787788.289376:0:14935:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1785787788.289459:0:14935:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41390380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14935:1872533770050688:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1785787788.295412:0:14935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787788.295464:0:14935:0:(client.c:2702:ptlrpc_set_wait()) set ffff91907fe400c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785787788.296574:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770050688 00000100:00100000:1.0:1785787788.296582:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770050688 00000100:00100000:1.0:1785787788.296640:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1785787788.296648:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+16:14935:x1872533770050688:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1785787788.297711:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+16:14935:x1872533770050688:12345-0@lo:502:mount.lustre.0 Request processed in 1062us (2300us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787788.297720:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1785787788.298899:0:14935:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41390380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14935:1872533770050688:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1785787788.299204:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1785787788.300584:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1785787788.301143:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1785787788.301205:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1785787788.301238:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1785787788.302378:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1785787788.302419:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1785787788.302457:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1785787788.302534:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1785787788.302575:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1785787788.302626:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1785787788.302679:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1785787788.302717:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1785787788.302765:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1785787788.302849:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1785787788.302900:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1785787788.307313:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1785787788.307447:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1785787788.307501:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1785787788.307539:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1785787788.307599:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1785787788.307639:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1785787788.307676:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1785787788.307737:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1785787788.307800:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1785787788.307852:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1785787788.309288:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1785787788.309337:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1785787788.309382:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1785787788.309432:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1785787788.310313:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1785787788.310357:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1785787788.310389:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1785787788.310436:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1785787788.310848:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1785787788.311141:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1785787788.311176:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1785787788.311207:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1785787788.311854:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1785787788.312128:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1785787788.312181:0:14935:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41390380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14935:1872533770050816:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1785787788.318255:0:14935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787788.318709:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770050816 00000100:00100000:1.0:1785787788.318718:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770050816 00000100:00100000:1.0:1785787788.318778:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1785787788.318787:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077639c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+16:14935:x1872533770050816:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1785787788.319209:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077639c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+16:14935:x1872533770050816:12345-0@lo:502:mount.lustre.0 Request processed in 422us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787788.319217:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1785787788.319279:0:14935:0:(client.c:2702:ptlrpc_set_wait()) set ffff91907fe400c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785787788.319302:0:14935:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41390380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14935:1872533770050816:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1785787788.319396:0:14935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1785787788.319410:0:14935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1785787788.321062:0:14958:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1785787788.321076:0:14958:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff91905d4a0000) 00000020:00000080:1.0:1785787788.321094:0:14958:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1785787788.321237:0:14958:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91904e8a5800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1785787788.321327:0:14958:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91904e8a5800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1785787788.321330:0:14958:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91904e8a5800 3 00010000:00080000:1.0:1785787788.321363:0:14958:0:(ldlm_lib.c:102:import_set_conn()) imp ffff919054308800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.153@tcp at head 00010000:00010000:1.0:1785787788.328328:0:14958:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1785787788.328426:0:14958:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1785787788.328461:0:14958:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1785787788.328637:0:14958:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xe2c2ff68a6e855fe 00000100:00080000:1.0:1785787788.328650:0:14958:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1785787788.328655:0:14958:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff919054308800 using connection 192.168.203.153@tcp/0@lo 00000100:00100000:1.0:1785787788.328694:0:14958:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91907fd91180 x1872533770050944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1785787788.328720:0:14958:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1785787788.328793:0:3332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1872533770050944:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1785787788.328885:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787788.330939:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770050944 00000100:00100000:0.0:1785787788.330950:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770050944 00000100:00100000:0.0:1785787788.330983:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1785787788.330990:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1872533770050944:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1785787788.331012:0:14303:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 575 last 0 00000020:00000080:0.0:1785787788.331059:0:14303:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xe2c2ff68a6e85605 00000004:00100000:0.0:1785787788.331074:0:14303:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1785787788.331103:0:14303:0:(import.c:65:import_set_state_nolock()) ffff9190513de800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1785787788.331170:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3332:x1872533770050944:12345-0@lo:38:llog_process_th.0 Request processed in 179us (2285us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787788.331178:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1785787788.331219:0:3332:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91907fd91180 x1872533770050944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1785787798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787788.331230:0:3332:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1785787788.331254:0:3332:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1785787788.331261:0:3332:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1785787788.331265:0:3332:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1785787788.331267:0:3332:0:(import.c:65:import_set_state_nolock()) ffff919054308800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1785787788.331273:0:3332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3332:1872533770050944:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1785787788.339583:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1785787788.339589:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1785787788.339601:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1785787788.339604:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1785787788.339666:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533770051072:0@lo:400:kworker.0 00000100:00100000:3.0:1785787788.339723:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787788.339793:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770051072 00000100:00100000:3.0:1785787788.339799:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770051072 00000100:00100000:3.0:1785787788.339853:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1785787788.339870:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076d88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533770051072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787788.339924:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076d88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533770051072:12345-0@lo:400:kworker.0 Request processed in 63us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787788.340601:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1785787788.340642:0:3334:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff919076d8a300 x1872533770051072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787788.340656:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533770051072:0@lo:400:kworker.0 00000040:00080000:1.0:1785787788.341503:0:14958:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1785787788.341696:0:14935:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1785787788.341722:0:14935:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1785787788.341749:0:14935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff91908206b400/0xe2c2ff68a6e855e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e855f0 expref: -99 pid: 14935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787788.341760:0:14935:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff91908206b400/0xe2c2ff68a6e855e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e855f0 expref: -99 pid: 14935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1785787788.341812:0:14935:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1785787788.341813:0:14935:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1785787788.341815:0:14935:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1785787788.341816:0:14935:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1785787788.341817:0:14935:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1785787788.341818:0:14935:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1785787788.341820:0:14935:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1785787788.341821:0:14935:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1785787788.341823:0:14935:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1785787788.341847:0:14935:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1785787788.341850:0:14935:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1785787788.341851:0:14935:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1785787788.341857:0:14935:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1785787788.341859:0:14935:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1785787788.341867:0:14935:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1785787788.341868:0:14935:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1785787788.341869:0:14935:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1785787788.341870:0:14935:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1785787788.341871:0:14935:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1785787788.341892:0:14935:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1785787788.341905:0:14935:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14935:1872533770051200:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1785787788.342081:0:14935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787788.342115:0:14935:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190771069c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785787788.342170:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770051200 00000100:00100000:3.0:1785787788.342175:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770051200 00000100:00100000:3.0:1785787788.342215:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1785787788.342223:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077639450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+16:14935:x1872533770051200:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1785787788.342253:0:14295:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1785787788.342266:0:14295:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1785787788.403526:0:14295:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1785787788.403569:0:14295:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1785787788.403751:0:14317:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1785787788.403756:0:14317:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1785787788.403848:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff919052f5f200/0xe2c2ff68a6e8560c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787788.403872:0:14317:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91904677c400/0xe2c2ff68a6e85579 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e85572 expref: 16 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787788.403880:0:14317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff919052f5f200/0xe2c2ff68a6e8560c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787788.403917:0:14317:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91904677c400/0xe2c2ff68a6e85579 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2c2ff68a6e85572 expref: 16 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787788.403939:0:14317:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91904677c400/0xe2c2ff68a6e85579 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2c2ff68a6e85572 expref: 16 pid: 14295 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787788.403953:0:14317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41393480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14317:1872533770051328:0@lo:104: 00000100:00100000:0.0:1785787788.404014:0:14317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787788.405499:0:14317:0:(client.c:2702:ptlrpc_set_wait()) set ffff91907fe40840 going to sleep for 11 seconds 00000100:00100000:2.0:1785787788.406847:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770051328 00000100:00100000:2.0:1785787788.406857:0:14284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770051328 00000100:00100000:2.0:1785787788.406921:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1785787788.407496:0:14284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41391c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f9a1da20-2955-44fa-b075-f73628199db8+3:14317:x1872533770051328:12345-0@lo:104: 00010000:00010000:2.0:1785787788.407512:0:14284:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff919052f5e000/0xe2c2ff68a6e85572 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e85579 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787788.407603:0:14284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1785787788.407610:0:14284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41391c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f9a1da20-2955-44fa-b075-f73628199db8+3:14317:x1872533770051328:12345-0@lo:104: Request processed in 119us (3595us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787788.407676:0:14317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41393480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14317:1872533770051328:0@lo:104: 00010000:00010000:1.0:1785787788.407699:0:14317:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff919052f5f200/0xe2c2ff68a6e8560c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787788.410642:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1785787788.410675:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785787788.410682:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff919052f5e000/0xe2c2ff68a6e85572 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e85579 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787788.410693:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919052f5e000 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:2.0:1785787788.410697:0:14290:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff919052f5e000/0xe2c2ff68a6e85572 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2c2ff68a6e85579 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787788.410706:0:14290:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff919052f5e000/0xe2c2ff68a6e85572 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2c2ff68a6e85579 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785787788.410739:0:14290:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff919052f5e000/0xe2c2ff68a6e85572 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2c2ff68a6e85579 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785787788.410745:0:14290:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1785787788.411062:0:14290:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff919052f5e000/0xe2c2ff68a6e85572 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e85579 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787788.411071:0:14290:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785787788.411099:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff919052f5e000/0xe2c2ff68a6e85572 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e85579 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787788.411107:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff919052f5e000/0xe2c2ff68a6e85572 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e85579 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787788.411124:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787788.411126:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787788.411128:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785787788.411140:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785787788.411152:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9a1da20-2955-44fa-b075-f73628199db8:3336:1872533770051456:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785787788.411207:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787788.411441:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770051456 00000100:00100000:2.0:1785787788.411447:0:14286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770051456 00010000:00010000:2.0:1785787788.411481:0:14286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91904677c400/0xe2c2ff68a6e85579 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e85572 expref: 17 pid: 14295 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787788.411512:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1785787788.411521:0:14286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9a1da20-2955-44fa-b075-f73628199db8+17:3336:x1872533770051456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785787788.411543:0:14286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785787788.411552:0:14286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91904677c400/0xe2c2ff68a6e85579 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e85572 expref: 17 pid: 14295 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787788.411564:0:14286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91904677c400/0xe2c2ff68a6e85579 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2c2ff68a6e85572 expref: 17 pid: 14295 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787788.411579:0:14286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91904677c400/0xe2c2ff68a6e85579 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2c2ff68a6e85572 expref: 17 pid: 14295 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787788.411593:0:14286:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff919052f5f200/0xe2c2ff68a6e8560c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787788.411601:0:14286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919052f5f200/0xe2c2ff68a6e8560c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1785787788.411625:0:14286:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007868653s 00010000:00010000:2.0:1785787788.411630:0:14286:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919052f5f200/0xe2c2ff68a6e8560c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787788.411638:0:14286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919052f5f200/0xe2c2ff68a6e8560c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787788.411645:0:14286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff919052f5f200/0xe2c2ff68a6e8560c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787788.411652:0:14286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff919052f5f200/0xe2c2ff68a6e8560c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787788.411658:0:14286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919052f5f200 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785787788.411662:0:14286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff919052f5f200/0xe2c2ff68a6e8560c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787788.411679:0:14286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff919052f5f200/0xe2c2ff68a6e8560c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787788.411695:0:14286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff919052f5f200/0xe2c2ff68a6e8560c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787788.411706:0:14286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785787788.411747:0:14286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9a1da20-2955-44fa-b075-f73628199db8+16:3336:x1872533770051456:12345-0@lo:103:ldlm_bl.0 Request processed in 227us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787788.411754:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1785787788.412111:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9a1da20-2955-44fa-b075-f73628199db8:3336:1872533770051456:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785787788.412132:0:14317:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff919052f5f200/0xe2c2ff68a6e8560c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787788.412141:0:14317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff919052f5f200/0xe2c2ff68a6e8560c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787788.412148:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919052f5f200/0xe2c2ff68a6e8560c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787788.428514:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077639450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+15:14935:x1872533770051200:12345-0@lo:253:mount.lustre.0 Request processed in 86284us (86425us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787788.428528:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1785787788.428756:0:14935:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:14935:1872533770051200:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1785787788.428846:0:14935:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1785787788.428850:0:14935:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1785787788.428852:0:14935:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1785787788.428853:0:14935:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1785787788.428854:0:14935:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1785787788.428856:0:14935:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1785787788.428857:0:14935:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1785787788.428858:0:14935:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1785787788.429014:0:14935:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1785787788.429029:0:14935:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1785787788.429045:0:14935:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1785787788.446211:0:14935:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1785787788.447562:0:14935:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1785787788.448156:0:14935:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1785787788.448435:0:14935:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1785787788.449215:0:14935:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1785787788.449435:0:14935:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1785787788.450745:0:14935:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1785787788.536037:0:14935:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1785787788.536046:0:14935:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1785787788.536077:0:14935:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1785787788.536131:0:14935:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.153@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1785787788.536143:0:14935:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1785787788.536168:0:14935:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1785787789.319960:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1785787790.067019:0:14298:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1785787790.067027:0:14298:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff91905f91f800 from 7 10000000:01000000:0.0:1785787790.067033:0:14298:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1785787790.067078:0:14298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff919052f5f600/0xe2c2ff68a6e85613 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787790.067104:0:14298:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff919052f5f600/0xe2c2ff68a6e85613 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787790.067116:0:14298:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff919052f5f600/0xe2c2ff68a6e85613 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787790.067139:0:14298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41393480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9a1da20-2955-44fa-b075-f73628199db8:14298:1872533770051584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1785787790.067198:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787790.067247:0:14298:0:(client.c:2702:ptlrpc_set_wait()) set ffff91907fe40d80 going to sleep for 11 seconds 00000100:00100000:2.0:1785787790.068559:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770051584 00000100:00100000:2.0:1785787790.068567:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770051584 00000100:00100000:2.0:1785787790.068620:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1785787790.068630:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+15:14298:x1872533770051584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785787790.068654:0:14294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787790.068669:0:14294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91904677d600/0xe2c2ff68a6e8561a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e85613 expref: -99 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787790.068700:0:14294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91904677d600/0xe2c2ff68a6e8561a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e85613 expref: 16 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787790.068711:0:14294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91904677d600/0xe2c2ff68a6e8561a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e85613 expref: 16 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787790.068728:0:14294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677d600, rc 0) 00000100:00100000:2.0:1785787790.068774:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+16:14298:x1872533770051584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (1574us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787790.068781:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1785787790.069137:0:14298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41393480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9a1da20-2955-44fa-b075-f73628199db8:14298:1872533770051584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785787790.069155:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff919052f5f600/0xe2c2ff68a6e85613 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e8561a expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787790.069164:0:14298:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff919052f5f600/0xe2c2ff68a6e85613 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e8561a expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787790.069218:0:14298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41393480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9a1da20-2955-44fa-b075-f73628199db8:14298:1872533770051712:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1785787790.069249:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787790.069280:0:14298:0:(client.c:2702:ptlrpc_set_wait()) set ffff91907fe40d80 going to sleep for 11 seconds 00000100:00100000:2.0:1785787790.069323:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770051712 00000100:00100000:2.0:1785787790.069328:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770051712 00000100:00100000:2.0:1785787790.069357:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1785787790.069364:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+16:14298:x1872533770051712:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1785787790.069384:0:14295:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1785787790.070135:0:14295:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1785787790.070140:0:14295:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1785787790.070217:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+16:14298:x1872533770051712:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 852us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787790.070225:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1785787790.071515:0:14298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41393480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9a1da20-2955-44fa-b075-f73628199db8:14298:1872533770051712:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1785787790.071596:0:14298:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1785787790.071605:0:14298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff919052f5f600/0xe2c2ff68a6e85613 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e8561a expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787790.071614:0:14298:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff919052f5f600/0xe2c2ff68a6e85613 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e8561a expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787790.323930:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787791.348909:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787792.388886:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787793.395763:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1785787793.844607:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1785787793.844616:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1785787793.844619:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1785787793.844623:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1785787793.844677:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9a1da20-2955-44fa-b075-f73628199db8:3336:1872533770051840:0@lo:400:kworker.0 00000100:00100000:2.0:1785787793.844777:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787793.844877:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1872533770051968:0@lo:400:kworker.0 00000100:00100000:2.0:1785787793.844909:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787793.844931:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785787793.844937:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3333:1872533770052096:0@lo:400:kworker.0 00000100:00100000:2.0:1785787793.844962:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787793.845304:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770051840 00000100:00100000:2.0:1785787793.845314:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770051840 00000100:00100000:2.0:1785787793.845370:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1785787793.845381:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905fafa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+16:3336:x1872533770051840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787793.845437:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905fafa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+16:3336:x1872533770051840:12345-0@lo:400:kworker.0 Request processed in 58us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787793.845454:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1785787793.846077:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9a1da20-2955-44fa-b075-f73628199db8:3336:1872533770051840:0@lo:400:kworker.0 00000100:00100000:1.0:1785787793.851130:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770051968 00000100:00100000:1.0:1785787793.851203:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770051968 00000100:00100000:1.0:1785787793.851272:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770052096 00000100:00100000:1.0:1785787793.851276:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770052096 00000100:00100000:1.0:1785787793.851311:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1785787793.851323:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1872533770051968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787793.851437:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1872533770051968:12345-0@lo:400:kworker.0 Request processed in 117us (6526us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787793.851445:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1785787793.851462:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1785787793.851468:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1872533770052096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787793.851495:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1872533770052096:12345-0@lo:400:kworker.0 Request processed in 28us (6534us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787793.851509:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1785787793.852742:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91907764e680 x1872533770052096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787793.852761:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3333:1872533770052096:0@lo:400:kworker.0 00010000:00080000:0.0:1785787793.852774:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91907764ed80 x1872533770051968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787793.852783:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1872533770051968:0@lo:400:kworker.0 00000100:00080000:1.0:1785787793.853447:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1785787794.419772:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1785787794.999488:0:14333:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1785787795.457330:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787796.476749:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787797.496403:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787797.561082:0:3332:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1785787782/real 1785787782] req@ffff91907764e300 x1872533770047616/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1785787797 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787797.561113:0:3332:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91907764e300 x1872533770047616/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1785787797 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787797.561123:0:3332:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1785787782/real 1785787782] req@ffff91907764c700 x1872533770047744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1785787797 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787797.561133:0:3332:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91907764c700 x1872533770047744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1785787797 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1785787797.561149:0:3332:0:(import.c:65:import_set_state_nolock()) ffff919077066800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1785787797.561165:0:3332:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1785787797.561175:0:3332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3332:1872533770047616:0@lo:8:kworker.0 00000100:00080000:3.0:1785787797.561181:0:3332:0:(import.c:65:import_set_state_nolock()) ffff91905fad9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1785787797.561185:0:3332:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1785787797.561188:0:3332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3332:1872533770047744:0@lo:8:kworker.0 00000100:00080000:1.0:1785787797.561862:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1785787797.561866:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1785787797.561869:0:37:0:(import.c:65:import_set_state_nolock()) ffff919077066800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1785787797.561874:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 569 00000100:00080000:1.0:1785787797.561878:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1785787797.561884:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff919077066800 using connection 192.168.203.153@tcp/0@lo 00000100:00100000:1.0:1785787797.561902:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91907fd93480 x1872533770052352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1785787797.561924:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1785787797.561927:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1785787797.561929:0:37:0:(import.c:65:import_set_state_nolock()) ffff91905fad9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1785787797.561931:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 569 00000100:00080000:1.0:1785787797.561933:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1785787797.561936:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91905fad9800 using connection 192.168.203.153@tcp/0@lo 00000100:00100000:1.0:1785787797.561946:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91907fd92d80 x1872533770052480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1785787797.561990:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3333:1872533770052736:0@lo:400:kworker.0 00000100:00100000:1.0:1785787797.562045:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787797.562103:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770052736 00000100:00100000:1.0:1785787797.562110:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770052736 00000100:00100000:1.0:1785787797.562161:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1785787797.562170:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1872533770052736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787797.562350:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1872533770052736:12345-0@lo:400:kworker.0 Request processed in 181us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787797.562357:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1785787797.562376:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1785787797.562401:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91907fd93b80 x1872533770052736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787797.562411:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3333:1872533770052736:0@lo:400:kworker.0 00000100:00100000:1.0:1785787797.562426:0:3332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3332:1872533770052352:0@lo:8:kworker.0 00000100:00100000:1.0:1785787797.562451:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787797.562501:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9a1da20-2955-44fa-b075-f73628199db8:3335:1872533770052224:0@lo:400:kworker.0 00000100:00100000:3.0:1785787797.562544:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787797.562580:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785787797.562587:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3335:1872533770052608:0@lo:400:kworker.0 00000100:00100000:3.0:1785787797.562620:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787797.562647:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770052224 00000100:00100000:3.0:1785787797.562651:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770052224 00000100:00100000:3.0:1785787797.562688:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1785787797.562695:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+16:3335:x1872533770052224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787797.562731:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+16:3335:x1872533770052224:12345-0@lo:400:kworker.0 Request processed in 36us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787797.562745:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1785787797.562770:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770052608 00000100:00100000:3.0:1785787797.562774:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770052608 00000100:00100000:3.0:1785787797.562794:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1785787797.562800:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076d8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3335:x1872533770052608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787797.562844:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076d8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3335:x1872533770052608:12345-0@lo:400:kworker.0 Request processed in 43us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787797.562849:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1785787797.562874:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91907fd90380 x1872533770052608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787797.562883:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3335:1872533770052608:0@lo:400:kworker.0 00000100:00100000:3.0:1785787797.562890:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9a1da20-2955-44fa-b075-f73628199db8:3335:1872533770052224:0@lo:400:kworker.0 00000100:00100000:1.0:1785787797.576077:0:3332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3332:1872533770052480:0@lo:8:kworker.0 00000100:00100000:1.0:1785787797.576132:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787797.577267:0:14937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770052352 00000100:00100000:0.0:1785787797.577275:0:14937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770052352 00000100:00100000:0.0:1785787797.577299:0:14937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770052480 00000100:00100000:0.0:1785787797.577301:0:14937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770052480 00000100:00100000:0.0:1785787797.577312:0:14937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1785787797.577319:0:14937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3332:x1872533770052352:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1785787797.577346:0:14937:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 584 last 0 00000020:00000080:0.0:1785787797.577372:0:14937:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe2c2ff68a6e85621 00002000:00100000:0.0:1785787797.577385:0:14937:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff919056aa2000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113801 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1785787797.577389:0:14937:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1785787797.577391:0:14937:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1785787797.577695:0:14937:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1785787797.577719:0:14937:0:(import.c:65:import_set_state_nolock()) ffff9190513dd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1785787797.577779:0:14937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3332:x1872533770052352:12345-0@lo:8:kworker.0 Request processed in 459us (15326us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787797.577786:0:14937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1785787797.577801:0:14937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1785787797.577976:0:14937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3332:x1872533770052480:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1785787797.578037:0:14937:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1785787797.578064:0:14937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3332:x1872533770052480:12345-0@lo:8:kworker.0 Request processed in 88us (1933us total) trans 0 rc -19/-19 00000100:00100000:0.0:1785787797.578071:0:14937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1785787797.579695:0:3332:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91907fd93480 x1872533770052352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1785787817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785787797.579706:0:3332:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1785787797.579714:0:3332:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1785787797.579722:0:3332:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1785787797.579727:0:3332:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1785787797.579730:0:3332:0:(import.c:65:import_set_state_nolock()) ffff919077066800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1785787797.579760:0:3332:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1785787797.579765:0:3332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3332:1872533770052352:0@lo:8:kworker.0 00000100:00080000:1.0:1785787797.579778:0:3332:0:(import.c:65:import_set_state_nolock()) ffff91905fad9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1785787797.579782:0:3332:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1785787797.579784:0:3332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3332:1872533770052480:0@lo:8:kworker.0 00000004:00080000:1.0:1785787797.580671:0:14323:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1785787797.581152:0:14323:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 584825322176ns, next at 0ns, rc = 0 00000004:00080000:0.0:1785787797.581950:0:14324:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:0.0:1785787797.581973:0:14324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41390380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14324:1872533770052992:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1785787797.582035:0:14324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787797.582060:0:14324:0:(client.c:2702:ptlrpc_set_wait()) set ffff919044e9d180 going to sleep for 11 seconds 00000100:00100000:0.0:1785787797.582098:0:14937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770052992 00000100:00100000:0.0:1785787797.582105:0:14937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770052992 00000100:00100000:0.0:1785787797.582152:0:14937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1785787797.582160:0:14937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41390000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14324:x1872533770052992:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1785787797.584631:0:14937:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1785787797.584639:0:14937:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1785787797.584644:0:14937:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00000100:00100000:1.0:1785787797.589604:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41393480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770052864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785787797.589687:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1785787797.590200:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785787797.630523:0:14940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770052864 00000100:00100000:1.0:1785787797.630538:0:14940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770052864 00000100:00100000:3.0:1785787797.630672:0:14941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1785787797.630684:0:14941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3334:x1872533770052864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785787797.630718:0:14941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785787797.630797:0:14941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3334:x1872533770052864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (41110us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787797.630804:0:14941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1785787797.630880:0:3334:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff918f41393480 x1872533770052864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787797.630899:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41393480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770052864:0@lo:13:osp-pre-0-0.0 00002000:00010000:0.0:1785787797.633692:0:14937:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1785787797.633703:0:14937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cae050f7/0xe2c2ff68a6e85628 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.633722:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=584s v=(0 0) 00010000:00010000:0.0:1785787797.633726:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785787797.633743:0:14937:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cae050f7/0xe2c2ff68a6e85628 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.633761:0:14937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cae050f7/0xe2c2ff68a6e85628 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.633778:0:14937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cae050f7/0xe2c2ff68a6e85628 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.633786:0:14937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cae050f7/0xe2c2ff68a6e85628 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.633810:0:14937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785787797.635629:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785787797.635638:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cae050f7/0xe2c2ff68a6e85628 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787797.635649:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919052f5f800 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785787797.635655:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cae050f7/0xe2c2ff68a6e85628 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787797.635676:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cae050f7/0xe2c2ff68a6e85628 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787797.635697:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cae050f7/0xe2c2ff68a6e85628 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787797.635705:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cae050f7/0xe2c2ff68a6e85628 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787797.635723:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787797.635725:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787797.635727:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785787797.651399:0:14937:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785787797.651412:0:14937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f57a774/0xe2c2ff68a6e8562f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.651428:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=584s v=(0 0) 00010000:00010000:1.0:1785787797.651432:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785787797.651437:0:14937:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f57a774/0xe2c2ff68a6e8562f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.651452:0:14937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f57a774/0xe2c2ff68a6e8562f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.651461:0:14937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f57a774/0xe2c2ff68a6e8562f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.651468:0:14937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f57a774/0xe2c2ff68a6e8562f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.651488:0:14937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1785787797.659673:0:14937:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785787797.659685:0:14937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0e1d39e/0xe2c2ff68a6e85636 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.659714:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=584s v=(0 0) 00010000:00010000:1.0:1785787797.659719:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785787797.659725:0:14937:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0e1d39e/0xe2c2ff68a6e85636 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.659739:0:14937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0e1d39e/0xe2c2ff68a6e85636 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.659750:0:14937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0e1d39e/0xe2c2ff68a6e85636 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.659758:0:14937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0e1d39e/0xe2c2ff68a6e85636 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.659787:0:14937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1785787797.659804:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1785787797.659810:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f57a774/0xe2c2ff68a6e8562f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.659818:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0f400 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785787797.659822:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f57a774/0xe2c2ff68a6e8562f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.659851:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f57a774/0xe2c2ff68a6e8562f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.659879:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f57a774/0xe2c2ff68a6e8562f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.659886:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f57a774/0xe2c2ff68a6e8562f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.659903:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785787797.659906:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0e1d39e/0xe2c2ff68a6e85636 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.659912:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0ea00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785787797.659915:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0e1d39e/0xe2c2ff68a6e85636 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.659921:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0e1d39e/0xe2c2ff68a6e85636 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.659930:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0e1d39e/0xe2c2ff68a6e85636 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.659937:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0e1d39e/0xe2c2ff68a6e85636 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.659948:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787797.659949:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787797.659956:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785787797.664560:0:14937:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785787797.664774:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787797.674877:0:14937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2ef123a/0xe2c2ff68a6e8563d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.674905:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=584s v=(0 0) 00010000:00010000:1.0:1785787797.674910:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785787797.674918:0:14937:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2ef123a/0xe2c2ff68a6e8563d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.674935:0:14937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2ef123a/0xe2c2ff68a6e8563d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.674947:0:14937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2ef123a/0xe2c2ff68a6e8563d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.674955:0:14937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2ef123a/0xe2c2ff68a6e8563d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.674984:0:14937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1785787797.675599:0:14937:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785787797.675606:0:14937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa3b8c89/0xe2c2ff68a6e85644 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.675615:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=584s v=(0 0) 00010000:00010000:1.0:1785787797.675618:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785787797.675622:0:14937:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa3b8c89/0xe2c2ff68a6e85644 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.675644:0:14937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa3b8c89/0xe2c2ff68a6e85644 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.675653:0:14937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa3b8c89/0xe2c2ff68a6e85644 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.675668:0:14937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa3b8c89/0xe2c2ff68a6e85644 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.675683:0:14937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1785787797.676107:0:14937:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785787797.676113:0:14937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fae39bd/0xe2c2ff68a6e8564b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.676122:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=584s v=(0 0) 00010000:00010000:1.0:1785787797.676125:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785787797.676129:0:14937:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fae39bd/0xe2c2ff68a6e8564b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.676138:0:14937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fae39bd/0xe2c2ff68a6e8564b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.676147:0:14937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fae39bd/0xe2c2ff68a6e8564b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.676167:0:14937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fae39bd/0xe2c2ff68a6e8564b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.676175:0:14937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1785787797.676556:0:14937:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785787797.676562:0:14937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aef30c8a/0xe2c2ff68a6e85652 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.676571:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=584s v=(0 0) 00010000:00010000:1.0:1785787797.676574:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785787797.676578:0:14937:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aef30c8a/0xe2c2ff68a6e85652 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.676586:0:14937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aef30c8a/0xe2c2ff68a6e85652 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.676593:0:14937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aef30c8a/0xe2c2ff68a6e85652 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.676601:0:14937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aef30c8a/0xe2c2ff68a6e85652 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.676609:0:14937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1785787797.677020:0:14937:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785787797.677026:0:14937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d26b494f/0xe2c2ff68a6e85659 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.677041:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=584s v=(0 0) 00010000:00010000:1.0:1785787797.677044:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785787797.677048:0:14937:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d26b494f/0xe2c2ff68a6e85659 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.677057:0:14937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d26b494f/0xe2c2ff68a6e85659 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.677065:0:14937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d26b494f/0xe2c2ff68a6e85659 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.677071:0:14937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d26b494f/0xe2c2ff68a6e85659 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.677080:0:14937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1785787797.677451:0:14937:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785787797.677457:0:14937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a3ddb1e/0xe2c2ff68a6e85660 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.677466:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=584s v=(0 0) 00010000:00010000:1.0:1785787797.677469:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785787797.677473:0:14937:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a3ddb1e/0xe2c2ff68a6e85660 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.677483:0:14937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a3ddb1e/0xe2c2ff68a6e85660 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.677501:0:14937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a3ddb1e/0xe2c2ff68a6e85660 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.677509:0:14937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a3ddb1e/0xe2c2ff68a6e85660 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.677517:0:14937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:0.0:1785787797.677724:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1785787797.677732:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2ef123a/0xe2c2ff68a6e8563d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.677741:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0fe00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:0.0:1785787797.677745:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2ef123a/0xe2c2ff68a6e8563d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.677754:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2ef123a/0xe2c2ff68a6e8563d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.677771:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2ef123a/0xe2c2ff68a6e8563d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.677779:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2ef123a/0xe2c2ff68a6e8563d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.677800:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1785787797.677810:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa3b8c89/0xe2c2ff68a6e85644 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.677817:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0ec00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:0.0:1785787797.677820:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa3b8c89/0xe2c2ff68a6e85644 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.677841:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa3b8c89/0xe2c2ff68a6e85644 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.677853:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa3b8c89/0xe2c2ff68a6e85644 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.677860:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa3b8c89/0xe2c2ff68a6e85644 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.677874:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1785787797.677876:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fae39bd/0xe2c2ff68a6e8564b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.677882:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0fa00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:0.0:1785787797.677886:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fae39bd/0xe2c2ff68a6e8564b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.677893:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fae39bd/0xe2c2ff68a6e8564b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.677915:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fae39bd/0xe2c2ff68a6e8564b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.677922:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fae39bd/0xe2c2ff68a6e8564b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.677934:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1785787797.677938:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aef30c8a/0xe2c2ff68a6e85652 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.677944:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0e400 already unused, calling callback (ffffffffc174c300) 00010000:00010000:0.0:1785787797.677948:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aef30c8a/0xe2c2ff68a6e85652 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.677956:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aef30c8a/0xe2c2ff68a6e85652 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.677965:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aef30c8a/0xe2c2ff68a6e85652 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.677972:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aef30c8a/0xe2c2ff68a6e85652 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.677983:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1785787797.677986:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d26b494f/0xe2c2ff68a6e85659 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.677999:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0e800 already unused, calling callback (ffffffffc174c300) 00010000:00010000:0.0:1785787797.678002:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d26b494f/0xe2c2ff68a6e85659 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.678009:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d26b494f/0xe2c2ff68a6e85659 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.678020:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d26b494f/0xe2c2ff68a6e85659 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.678027:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d26b494f/0xe2c2ff68a6e85659 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.678042:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785787797.678045:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a3ddb1e/0xe2c2ff68a6e85660 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.678050:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0ee00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:0.0:1785787797.678053:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a3ddb1e/0xe2c2ff68a6e85660 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.678060:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a3ddb1e/0xe2c2ff68a6e85660 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.678070:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a3ddb1e/0xe2c2ff68a6e85660 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.678084:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a3ddb1e/0xe2c2ff68a6e85660 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.678097:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787797.678099:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787797.678100:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787797.678274:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785787797.688789:0:14937:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785787797.688802:0:14937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f6e5b66/0xe2c2ff68a6e85667 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.688820:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=584s v=(0 0) 00010000:00010000:1.0:1785787797.688825:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785787797.689133:0:14937:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f6e5b66/0xe2c2ff68a6e85667 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.689150:0:14937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f6e5b66/0xe2c2ff68a6e85667 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.689160:0:14937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f6e5b66/0xe2c2ff68a6e85667 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.689168:0:14937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f6e5b66/0xe2c2ff68a6e85667 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.689245:0:14937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1785787797.690245:0:14937:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785787797.690253:0:14937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000260544e0/0xe2c2ff68a6e8566e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.690263:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=584s v=(0 0) 00010000:00010000:1.0:1785787797.690267:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785787797.690271:0:14937:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000260544e0/0xe2c2ff68a6e8566e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.690282:0:14937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000260544e0/0xe2c2ff68a6e8566e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.690291:0:14937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000260544e0/0xe2c2ff68a6e8566e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.690298:0:14937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000260544e0/0xe2c2ff68a6e8566e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.697273:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1785787797.697287:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f6e5b66/0xe2c2ff68a6e85667 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.697300:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0f800 already unused, calling callback (ffffffffc174c300) 00010000:00010000:0.0:1785787797.697305:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f6e5b66/0xe2c2ff68a6e85667 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.697326:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f6e5b66/0xe2c2ff68a6e85667 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.697345:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f6e5b66/0xe2c2ff68a6e85667 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.697351:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f6e5b66/0xe2c2ff68a6e85667 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.697410:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785787797.697414:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000260544e0/0xe2c2ff68a6e8566e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.697426:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0f600 already unused, calling callback (ffffffffc174c300) 00010000:00010000:0.0:1785787797.697429:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000260544e0/0xe2c2ff68a6e8566e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.697437:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000260544e0/0xe2c2ff68a6e8566e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.697446:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000260544e0/0xe2c2ff68a6e8566e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.697453:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787797.697455:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787797.697456:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787797.700557:0:14937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1785787797.700737:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787797.700760:0:14937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000260544e0/0xe2c2ff68a6e8566e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1785787797.708173:0:14937:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785787797.708188:0:14937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0e1d39e/0xe2c2ff68a6e85675 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.708211:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=584s v=(0 0) 00010000:00010000:1.0:1785787797.708215:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785787797.708221:0:14937:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0e1d39e/0xe2c2ff68a6e85675 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.708235:0:14937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0e1d39e/0xe2c2ff68a6e85675 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.708245:0:14937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0e1d39e/0xe2c2ff68a6e85675 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.708253:0:14937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0e1d39e/0xe2c2ff68a6e85675 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.708282:0:14937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1785787797.709347:0:14937:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785787797.709354:0:14937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f57a774/0xe2c2ff68a6e8567c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.709363:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=584s v=(0 0) 00010000:00010000:1.0:1785787797.709367:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785787797.709370:0:14937:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f57a774/0xe2c2ff68a6e8567c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.709380:0:14937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f57a774/0xe2c2ff68a6e8567c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.709400:0:14937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f57a774/0xe2c2ff68a6e8567c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.709407:0:14937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f57a774/0xe2c2ff68a6e8567c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.709426:0:14937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1785787797.709441:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1785787797.709446:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0e1d39e/0xe2c2ff68a6e85675 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.709454:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0ea00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785787797.709458:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0e1d39e/0xe2c2ff68a6e85675 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.709466:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0e1d39e/0xe2c2ff68a6e85675 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.709482:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0e1d39e/0xe2c2ff68a6e85675 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.709489:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0e1d39e/0xe2c2ff68a6e85675 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.709506:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785787797.709515:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f57a774/0xe2c2ff68a6e8567c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.709520:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0f400 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785787797.709523:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f57a774/0xe2c2ff68a6e8567c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.709530:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f57a774/0xe2c2ff68a6e8567c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.709540:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f57a774/0xe2c2ff68a6e8567c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.709546:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f57a774/0xe2c2ff68a6e8567c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.709557:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787797.709559:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787797.709560:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785787797.714231:0:14937:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785787797.714244:0:14937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000260544e0/0xe2c2ff68a6e85683 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.714261:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=584s v=(0 0) 00010000:00010000:1.0:1785787797.714266:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785787797.714271:0:14937:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000260544e0/0xe2c2ff68a6e85683 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.714298:0:14937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000260544e0/0xe2c2ff68a6e85683 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.714438:0:14937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000260544e0/0xe2c2ff68a6e85683 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.714448:0:14937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000260544e0/0xe2c2ff68a6e85683 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.714467:0:14937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785787797.714483:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785787797.714489:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000260544e0/0xe2c2ff68a6e85683 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.714496:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0f600 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785787797.714500:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000260544e0/0xe2c2ff68a6e85683 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.714509:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000260544e0/0xe2c2ff68a6e85683 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.714539:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000260544e0/0xe2c2ff68a6e85683 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.714547:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000260544e0/0xe2c2ff68a6e85683 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.722418:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787797.722425:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787797.722427:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785787797.723202:0:14937:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785787797.723212:0:14937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008aa37d03/0xe2c2ff68a6e8568a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.723227:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=584s v=(0 0) 00010000:00010000:1.0:1785787797.723232:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785787797.723239:0:14937:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008aa37d03/0xe2c2ff68a6e8568a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.723254:0:14937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008aa37d03/0xe2c2ff68a6e8568a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.723264:0:14937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008aa37d03/0xe2c2ff68a6e8568a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.723272:0:14937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008aa37d03/0xe2c2ff68a6e8568a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.723292:0:14937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785787797.723301:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785787797.723601:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787797.726807:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008aa37d03/0xe2c2ff68a6e8568a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.726853:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0fc00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785787797.726859:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008aa37d03/0xe2c2ff68a6e8568a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.726869:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008aa37d03/0xe2c2ff68a6e8568a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.726889:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008aa37d03/0xe2c2ff68a6e8568a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.726898:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008aa37d03/0xe2c2ff68a6e8568a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.726920:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787797.726922:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787797.726924:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785787797.727496:0:14937:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785787797.727503:0:14937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000485b1d78/0xe2c2ff68a6e85691 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.727515:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=584s v=(0 0) 00010000:00010000:1.0:1785787797.727520:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785787797.727526:0:14937:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000485b1d78/0xe2c2ff68a6e85691 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.727537:0:14937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000485b1d78/0xe2c2ff68a6e85691 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.727552:0:14937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000485b1d78/0xe2c2ff68a6e85691 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.727560:0:14937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000485b1d78/0xe2c2ff68a6e85691 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.727576:0:14937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1785787797.727994:0:14937:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785787797.728000:0:14937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d24f0145/0xe2c2ff68a6e85698 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.728009:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=584s v=(0 0) 00010000:00010000:1.0:1785787797.728012:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785787797.728017:0:14937:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d24f0145/0xe2c2ff68a6e85698 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.728026:0:14937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d24f0145/0xe2c2ff68a6e85698 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.728034:0:14937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d24f0145/0xe2c2ff68a6e85698 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.728040:0:14937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d24f0145/0xe2c2ff68a6e85698 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.728065:0:14937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1785787797.728075:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1785787797.728080:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000485b1d78/0xe2c2ff68a6e85691 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.728087:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0e600 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785787797.728090:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000485b1d78/0xe2c2ff68a6e85691 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.728097:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000485b1d78/0xe2c2ff68a6e85691 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.728109:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000485b1d78/0xe2c2ff68a6e85691 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.728115:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000485b1d78/0xe2c2ff68a6e85691 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.728128:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785787797.728130:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d24f0145/0xe2c2ff68a6e85698 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.728135:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0f000 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785787797.728138:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d24f0145/0xe2c2ff68a6e85698 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.728156:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d24f0145/0xe2c2ff68a6e85698 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.728166:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d24f0145/0xe2c2ff68a6e85698 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.728172:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d24f0145/0xe2c2ff68a6e85698 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.728185:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787797.728186:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787797.728188:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785787797.729166:0:14937:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785787797.729172:0:14937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f6e5b66/0xe2c2ff68a6e8569f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.729182:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=584s v=(0 0) 00010000:00010000:1.0:1785787797.729186:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785787797.729190:0:14937:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f6e5b66/0xe2c2ff68a6e8569f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.729200:0:14937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f6e5b66/0xe2c2ff68a6e8569f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.729208:0:14937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f6e5b66/0xe2c2ff68a6e8569f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.729221:0:14937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f6e5b66/0xe2c2ff68a6e8569f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.729235:0:14937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785787797.729245:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785787797.729249:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f6e5b66/0xe2c2ff68a6e8569f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.729256:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0f800 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785787797.729259:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f6e5b66/0xe2c2ff68a6e8569f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.729266:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f6e5b66/0xe2c2ff68a6e8569f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.729277:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f6e5b66/0xe2c2ff68a6e8569f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.729284:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f6e5b66/0xe2c2ff68a6e8569f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.729297:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787797.729299:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787797.729301:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785787797.743843:0:14937:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785787797.743865:0:14937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a3ddb1e/0xe2c2ff68a6e856a6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.743882:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=584s v=(0 0) 00010000:00010000:1.0:1785787797.743886:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785787797.743891:0:14937:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a3ddb1e/0xe2c2ff68a6e856a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.743905:0:14937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a3ddb1e/0xe2c2ff68a6e856a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.743914:0:14937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a3ddb1e/0xe2c2ff68a6e856a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.743920:0:14937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a3ddb1e/0xe2c2ff68a6e856a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.743940:0:14937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785787797.743955:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785787797.743961:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a3ddb1e/0xe2c2ff68a6e856a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.743968:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0ee00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785787797.743971:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a3ddb1e/0xe2c2ff68a6e856a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.743979:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a3ddb1e/0xe2c2ff68a6e856a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.745094:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a3ddb1e/0xe2c2ff68a6e856a6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.745101:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a3ddb1e/0xe2c2ff68a6e856a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.745124:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787797.745126:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787797.745127:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785787797.745640:0:14937:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785787797.745645:0:14937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d26b494f/0xe2c2ff68a6e856ad lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.745654:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=584s v=(0 0) 00010000:00010000:1.0:1785787797.745658:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785787797.745673:0:14937:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d26b494f/0xe2c2ff68a6e856ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.745683:0:14937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d26b494f/0xe2c2ff68a6e856ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.745691:0:14937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d26b494f/0xe2c2ff68a6e856ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.745698:0:14937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d26b494f/0xe2c2ff68a6e856ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.745723:0:14937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785787797.745732:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785787797.745737:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d26b494f/0xe2c2ff68a6e856ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.745744:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0e800 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785787797.745748:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d26b494f/0xe2c2ff68a6e856ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.745756:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d26b494f/0xe2c2ff68a6e856ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.745767:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d26b494f/0xe2c2ff68a6e856ad lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.745774:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d26b494f/0xe2c2ff68a6e856ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.745788:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787797.745789:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787797.745791:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787797.746214:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785787797.752267:0:14937:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785787797.752281:0:14937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aef30c8a/0xe2c2ff68a6e856b4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.752299:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=584s v=(0 0) 00010000:00010000:1.0:1785787797.752311:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785787797.752317:0:14937:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aef30c8a/0xe2c2ff68a6e856b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.752331:0:14937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aef30c8a/0xe2c2ff68a6e856b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.752342:0:14937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aef30c8a/0xe2c2ff68a6e856b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.752350:0:14937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aef30c8a/0xe2c2ff68a6e856b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.752369:0:14937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1785787797.752872:0:14937:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785787797.752878:0:14937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fae39bd/0xe2c2ff68a6e856bb lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.752885:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=584s v=(0 0) 00010000:00010000:1.0:1785787797.752889:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785787797.752893:0:14937:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fae39bd/0xe2c2ff68a6e856bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.752902:0:14937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fae39bd/0xe2c2ff68a6e856bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.752910:0:14937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fae39bd/0xe2c2ff68a6e856bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.752924:0:14937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fae39bd/0xe2c2ff68a6e856bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.752940:0:14937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1785787797.754526:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1785787797.754535:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aef30c8a/0xe2c2ff68a6e856b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787797.754545:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0e400 already unused, calling callback (ffffffffc174c300) 00010000:00010000:3.0:1785787797.754550:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aef30c8a/0xe2c2ff68a6e856b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787797.754559:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aef30c8a/0xe2c2ff68a6e856b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787797.754580:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aef30c8a/0xe2c2ff68a6e856b4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787797.754589:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aef30c8a/0xe2c2ff68a6e856b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787797.754609:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785787797.754613:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fae39bd/0xe2c2ff68a6e856bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787797.754619:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0fa00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:3.0:1785787797.754622:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fae39bd/0xe2c2ff68a6e856bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787797.754640:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fae39bd/0xe2c2ff68a6e856bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787797.754651:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fae39bd/0xe2c2ff68a6e856bb lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787797.754658:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fae39bd/0xe2c2ff68a6e856bb lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787797.754681:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787797.754683:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787797.754684:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787797.756800:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785787797.758271:0:14937:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785787797.758281:0:14937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa3b8c89/0xe2c2ff68a6e856c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.758295:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=585s v=(0 0) 00010000:00010000:1.0:1785787797.758300:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785787797.758305:0:14937:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa3b8c89/0xe2c2ff68a6e856c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.758319:0:14937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa3b8c89/0xe2c2ff68a6e856c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.758328:0:14937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa3b8c89/0xe2c2ff68a6e856c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.758335:0:14937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa3b8c89/0xe2c2ff68a6e856c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.758352:0:14937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1785787797.759109:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785787797.759117:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa3b8c89/0xe2c2ff68a6e856c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787797.759126:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0ec00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:3.0:1785787797.759130:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa3b8c89/0xe2c2ff68a6e856c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787797.759138:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa3b8c89/0xe2c2ff68a6e856c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787797.759154:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa3b8c89/0xe2c2ff68a6e856c2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787797.759172:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa3b8c89/0xe2c2ff68a6e856c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787797.759191:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787797.759193:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787797.759194:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785787797.770904:0:14937:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785787797.770917:0:14937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2ef123a/0xe2c2ff68a6e856c9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.770940:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=585s v=(0 0) 00010000:00010000:1.0:1785787797.770945:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785787797.770951:0:14937:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2ef123a/0xe2c2ff68a6e856c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.770965:0:14937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2ef123a/0xe2c2ff68a6e856c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.770976:0:14937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2ef123a/0xe2c2ff68a6e856c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.770983:0:14937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2ef123a/0xe2c2ff68a6e856c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.771009:0:14937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1785787797.771509:0:14937:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785787797.771515:0:14937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca7b6c9e/0xe2c2ff68a6e856d0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.771524:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=585s v=(0 0) 00010000:00010000:1.0:1785787797.771527:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785787797.771531:0:14937:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca7b6c9e/0xe2c2ff68a6e856d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.771540:0:14937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca7b6c9e/0xe2c2ff68a6e856d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.771558:0:14937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca7b6c9e/0xe2c2ff68a6e856d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.771565:0:14937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca7b6c9e/0xe2c2ff68a6e856d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.771596:0:14937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1785787797.772631:0:14937:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785787797.772638:0:14937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fc1341e/0xe2c2ff68a6e856d7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.772648:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=585s v=(0 0) 00010000:00010000:1.0:1785787797.772652:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785787797.772656:0:14937:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fc1341e/0xe2c2ff68a6e856d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.772679:0:14937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fc1341e/0xe2c2ff68a6e856d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.772688:0:14937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fc1341e/0xe2c2ff68a6e856d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.772696:0:14937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004fc1341e/0xe2c2ff68a6e856d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.772716:0:14937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1785787797.773178:0:14937:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785787797.773185:0:14937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e2aa52f/0xe2c2ff68a6e856de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.773193:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=585s v=(0 0) 00010000:00010000:1.0:1785787797.773196:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785787797.773200:0:14937:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e2aa52f/0xe2c2ff68a6e856de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.773209:0:14937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e2aa52f/0xe2c2ff68a6e856de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.773218:0:14937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e2aa52f/0xe2c2ff68a6e856de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.773225:0:14937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e2aa52f/0xe2c2ff68a6e856de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.773234:0:14937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1785787797.773645:0:14937:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785787797.773650:0:14937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb313be4/0xe2c2ff68a6e856e5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787797.774144:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1785787797.774151:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2ef123a/0xe2c2ff68a6e856c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787797.774160:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919043c0fe00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:3.0:1785787797.774165:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2ef123a/0xe2c2ff68a6e856c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787797.774174:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2ef123a/0xe2c2ff68a6e856c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787797.774192:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2ef123a/0xe2c2ff68a6e856c9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787797.774200:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2ef123a/0xe2c2ff68a6e856c9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787797.774218:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1785787797.774223:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca7b6c9e/0xe2c2ff68a6e856d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787797.774236:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190443c5000 already unused, calling callback (ffffffffc174c300) 00010000:00010000:3.0:1785787797.774240:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca7b6c9e/0xe2c2ff68a6e856d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787797.774247:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca7b6c9e/0xe2c2ff68a6e856d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787797.774257:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca7b6c9e/0xe2c2ff68a6e856d0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787797.774264:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca7b6c9e/0xe2c2ff68a6e856d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787797.774277:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1785787797.774280:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004fc1341e/0xe2c2ff68a6e856d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787797.774285:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190443c5400 already unused, calling callback (ffffffffc174c300) 00010000:00010000:3.0:1785787797.774288:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004fc1341e/0xe2c2ff68a6e856d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787797.774294:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004fc1341e/0xe2c2ff68a6e856d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787797.774303:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004fc1341e/0xe2c2ff68a6e856d7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787797.774315:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fc1341e/0xe2c2ff68a6e856d7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787797.774327:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785787797.774330:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e2aa52f/0xe2c2ff68a6e856de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787797.774337:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190443c5c00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:3.0:1785787797.774340:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e2aa52f/0xe2c2ff68a6e856de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787797.774348:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e2aa52f/0xe2c2ff68a6e856de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787797.774359:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e2aa52f/0xe2c2ff68a6e856de lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787797.774366:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e2aa52f/0xe2c2ff68a6e856de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787797.774377:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787797.774379:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787797.774381:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787797.775746:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1785787797.777462:0:5843:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:1.0:1785787797.779087:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=585s v=(0 0) 00010000:00010000:1.0:1785787797.779109:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785787797.779118:0:14937:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb313be4/0xe2c2ff68a6e856e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.779137:0:14937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb313be4/0xe2c2ff68a6e856e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.779147:0:14937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb313be4/0xe2c2ff68a6e856e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.779155:0:14937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb313be4/0xe2c2ff68a6e856e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787797.779209:0:14937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1785787797.781651:0:14937:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:1.0:1785787797.781775:0:14937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41390000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14324:x1872533770052992:12345-0@lo:5:osp-pre-0-0.0 Request processed in 199611us (199736us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787797.781789:0:14937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1785787797.781900:0:14324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41390380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14324:1872533770052992:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1785787797.781915:0:14324:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:1.0:1785787797.781958:0:14324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd93480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14324:1872533770053120:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1785787797.781992:0:14324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787797.782034:0:14324:0:(client.c:2702:ptlrpc_set_wait()) set ffff919048290c00 going to sleep for 11 seconds 00000100:00100000:3.0:1785787797.782114:0:14938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770053120 00000100:00100000:3.0:1785787797.782121:0:14938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770053120 00000100:00100000:3.0:1785787797.782149:0:14938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1785787797.782162:0:14938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14324:x1872533770053120:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1785787797.782200:0:14938:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:0.0:1785787797.790793:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785787797.790805:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb313be4/0xe2c2ff68a6e856e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.790819:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190443c4400 already unused, calling callback (ffffffffc174c300) 00010000:00010000:0.0:1785787797.790824:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb313be4/0xe2c2ff68a6e856e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.790850:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb313be4/0xe2c2ff68a6e856e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.790883:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb313be4/0xe2c2ff68a6e856e5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.790891:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb313be4/0xe2c2ff68a6e856e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787797.790912:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787797.790914:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787797.790916:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787797.799816:0:14938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14324:x1872533770053120:12345-0@lo:5:osp-pre-0-0.0 Request processed in 17644us (17813us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1785787797.799843:0:14938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1785787797.800040:0:14324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd93480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14324:1872533770053120:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1785787797.800055:0:14324:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:2.0:1785787798.514949:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1785787798.861300:0:15304:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg353-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000001:00100000:1.0:1785787799.169243:0:6642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1785787799.169348:0:6642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:3.0:1785787799.539025:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787800.564967:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787801.586945:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787802.612311:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787803.060251:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770053248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785787803.060336:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787803.060790:0:14941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770053248 00000100:00100000:2.0:1785787803.060799:0:14941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770053248 00000100:00100000:2.0:1785787803.060890:0:14941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1785787803.060903:0:14941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076d89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533770053248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785787803.060947:0:14941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785787803.060999:0:14941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076d89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533770053248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787803.061006:0:14941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1785787803.061029:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785787803.061067:0:3335:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1785787803.061090:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770053248:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1785787803.067144:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1785787803.067153:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1785787803.067158:0:36:0:(import.c:65:import_set_state_nolock()) ffff91905fad9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1785787803.067169:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 584 00000100:00080000:2.0:1785787803.067176:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1785787803.067184:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91905fad9800 using connection 192.168.203.153@tcp/0@lo 00000100:00100000:2.0:1785787803.067212:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91907764c000 x1872533770053504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1785787803.067279:0:3332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3332:1872533770053504:0@lo:8:kworker.0 00000100:00100000:2.0:1785787803.067364:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787803.067418:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1872533770053632:0@lo:400:kworker.0 00000100:00100000:2.0:1785787803.067466:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787803.067501:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785787803.067507:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3333:1872533770053760:0@lo:400:kworker.0 00000100:00100000:2.0:1785787803.067532:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787803.067579:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770053632 00000100:00100000:2.0:1785787803.067587:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770053632 00000100:00100000:1.0:1785787803.067781:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9a1da20-2955-44fa-b075-f73628199db8:3336:1872533770053376:0@lo:400:kworker.0 00000100:00100000:1.0:1785787803.067818:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787803.067887:0:14937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770053504 00000100:00100000:1.0:1785787803.067891:0:14937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770053504 00000100:00100000:1.0:1785787803.067915:0:14937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1785787803.067923:0:14937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3332:x1872533770053504:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1785787803.067944:0:14937:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1785787803.068112:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770053760 00000100:00100000:2.0:1785787803.068116:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770053760 00000100:00100000:2.0:1785787803.068146:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1785787803.068152:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1872533770053632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787803.068206:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1872533770053632:12345-0@lo:400:kworker.0 Request processed in 53us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787803.068214:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1785787803.068231:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1785787803.068238:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1872533770053760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787803.068266:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1872533770053760:12345-0@lo:400:kworker.0 Request processed in 29us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787803.068272:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1785787803.068296:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770053376 00000100:00100000:2.0:1785787803.068300:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770053376 00000100:00100000:2.0:1785787803.068330:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1785787803.068336:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905fafa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+16:3336:x1872533770053376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787803.068368:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905fafa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+16:3336:x1872533770053376:12345-0@lo:400:kworker.0 Request processed in 33us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787803.068375:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1785787803.068401:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785787803.068428:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9a1da20-2955-44fa-b075-f73628199db8:3336:1872533770053376:0@lo:400:kworker.0 00010000:00080000:2.0:1785787803.068466:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91907764d880 x1872533770053760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787803.068477:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3333:1872533770053760:0@lo:400:kworker.0 00010000:00080000:2.0:1785787803.068516:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91907764d180 x1872533770053632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787803.068634:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1872533770053632:0@lo:400:kworker.0 00000100:00100000:1.0:1785787803.090944:0:14937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3332:x1872533770053504:12345-0@lo:8:kworker.0 Request processed in 23014us (23573us total) trans 0 rc -19/-19 00000100:00100000:1.0:1785787803.090958:0:14937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1785787803.093985:0:3332:0:(import.c:65:import_set_state_nolock()) ffff91905fad9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1785787803.094000:0:3332:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1785787803.094005:0:3332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3332:1872533770053504:0@lo:8:kworker.0 00010000:00010000:3.0:1785787803.636441:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1785787804.212712:0:14333:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1785787804.658985:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787805.699481:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787806.714629:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787807.733738:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1785787808.057376:0:15607:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1785787808.057379:0:15607:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1785787808.057498:0:15607:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff919077aad800 00000020:01000004:2.0:1785787808.057512:0:15607:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1785787808.057523:0:15607:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1785787808.057535:0:15607:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff91905c494d40) 00000020:00000080:2.0:1785787808.057548:0:15607:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1785787808.109575:0:15607:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1785787808.109851:0:15607:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1785787808.110448:0:15607:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1785787808.115074:0:15607:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1785787808.116415:0:15607:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1785787808.117768:0:15607:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 631: rc = 0 00100000:10000000:2.0:1785787808.118745:0:15607:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 631: rc = 0 00100000:10000000:2.0:1785787808.118914:0:15607:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 631: rc = 0 00100000:10000000:2.0:1785787808.119297:0:15607:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 82: rc = 0 00100000:10000000:2.0:1785787808.119600:0:15607:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 82: rc = 0 00100000:10000000:2.0:1785787808.120889:0:15607:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 82: rc = 0 00100000:10000000:2.0:1785787808.121146:0:15607:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 82: rc = 0 00100000:10000000:2.0:1785787808.121985:0:15607:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 82: rc = 0 00100000:10000000:2.0:1785787808.122229:0:15607:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 82: rc = 0 00000020:00000080:2.0:1785787808.123004:0:15607:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1785787808.123015:0:15607:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1785787808.123024:0:15607:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe2c2ff68a6e856f3 00000020:01000004:2.0:1785787808.123033:0:15607:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1785787808.123052:0:15607:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.153@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1785787808.123055:0:15607:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1785787808.123061:0:15607:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1785787808.123081:0:15607:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1785787808.123084:0:15607:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.153@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1785787808.134041:0:15607:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.153@tcp ctxt 0 is initialized 00000020:01000004:2.0:1785787808.134077:0:15607:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.153@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1785787808.134082:0:15607:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1785787808.134084:0:15607:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1785787808.134085:0:15607:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1785787808.134087:0:15607:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1785787808.134088:0:15607:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1785787808.134089:0:15607:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1785787808.134091:0:15607:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1785787808.134092:0:15607:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1785787808.134094:0:15607:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1785787808.134097:0:15607:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1785787808.134100:0:15607:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1785787808.134101:0:15607:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1785787808.134102:0:15607:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1785787808.134104:0:15607:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1785787808.134105:0:15607:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1785787808.134106:0:15607:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1785787808.134107:0:15607:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1785787808.134108:0:15607:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1785787808.134113:0:15607:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1785787808.134146:0:15607:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1785787808.134166:0:15607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:15607:1872533770053888:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1785787808.134228:0:15607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787808.134409:0:15607:0:(client.c:2702:ptlrpc_set_wait()) set ffff919046e0ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1785787808.134726:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770053888 00000100:00100000:0.0:1785787808.134733:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770053888 00000100:00100000:0.0:1785787808.134810:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1785787808.134821:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+16:15607:x1872533770053888:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1785787808.134869:0:14296:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1785787808.134873:0:14296:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1785787808.134877:0:14296:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1785787808.149797:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+16:15607:x1872533770053888:12345-0@lo:253:mount.lustre.0 Request processed in 14969us (15559us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787808.149811:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1785787808.149946:0:15607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:15607:1872533770053888:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1785787808.149962:0:15607:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1785787808.149965:0:15607:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1785787808.149967:0:15607:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1785787808.149968:0:15607:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1785787808.149970:0:15607:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1785787808.149971:0:15607:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1785787808.149973:0:15607:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1785787808.149974:0:15607:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1785787808.149976:0:15607:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1785787808.149978:0:15607:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1785787808.149997:0:15607:0:(tgt_mount.c:101:server_register_mount()) register mount ffff919077aad800 from lustre-OST0001 10000000:01000000:0.0:1785787808.150036:0:15607:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1785787808.150039:0:15607:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1785787808.150046:0:15607:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9190507f3380 local copy 00010000:00010000:0.0:1785787808.150057:0:15607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff91908206b600/0xe2c2ff68a6e85499 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e854a0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787808.150274:0:15607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41390700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:15607:1872533770054016:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1785787808.150307:0:15607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787808.150347:0:15607:0:(client.c:2702:ptlrpc_set_wait()) set ffff91904689b480 going to sleep for 11 seconds 00000100:00100000:1.0:1785787808.150492:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770054016 00000100:00100000:1.0:1785787808.150499:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770054016 00000100:00100000:1.0:1785787808.150542:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1785787808.150550:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905fafac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+16:15607:x1872533770054016:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1785787808.150963:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905fafac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+16:15607:x1872533770054016:12345-0@lo:501:mount.lustre.0 Request processed in 413us (654us total) trans 0 rc -2/-2 00000100:00100000:1.0:1785787808.150970:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1785787808.151421:0:15607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41390700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:15607:1872533770054016:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1785787808.151434:0:15607:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1785787808.151605:0:15607:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1785787808.151612:0:15607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff91908206b600/0xe2c2ff68a6e85499 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e854a0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787808.151620:0:15607:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff91908206b600/0xe2c2ff68a6e85499 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e854a0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785787808.151641:0:15607:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff919077aad800 10000000:01000000:0.0:1785787808.151645:0:15607:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1785787808.151649:0:15607:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1785787808.151652:0:15607:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1785787808.151656:0:15607:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1785787808.151658:0:15607:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1785787808.151680:0:15607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff919052f5f800/0xe2c2ff68a6e856fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787808.151689:0:15607:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff919052f5f800/0xe2c2ff68a6e856fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787808.151706:0:15607:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff919052f5f800/0xe2c2ff68a6e856fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787808.151716:0:15607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41390700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:15607:1872533770054144:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1785787808.151735:0:15607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787808.151757:0:15607:0:(client.c:2702:ptlrpc_set_wait()) set ffff91904689b480 going to sleep for 11 seconds 00000100:00100000:2.0:1785787808.151767:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770054144 00000100:00100000:2.0:1785787808.151772:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770054144 00000100:00100000:2.0:1785787808.151803:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1785787808.151810:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905fafb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+16:15607:x1872533770054144:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1785787808.151819:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787808.151868:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91904677ca00/0xe2c2ff68a6e85701 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e856fa expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787808.151889:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91904677ca00/0xe2c2ff68a6e85701 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e856fa expref: 17 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787808.151899:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91904677ca00/0xe2c2ff68a6e85701 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e856fa expref: 17 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787808.151907:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677ca00, rc 0) 00000100:00100000:2.0:1785787808.151936:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905fafb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+17:15607:x1872533770054144:12345-0@lo:101:mount.lustre.0 Request processed in 126us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787808.151941:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1785787808.152026:0:15607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41390700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:15607:1872533770054144:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1785787808.152038:0:15607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff919052f5f800/0xe2c2ff68a6e856fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e85701 expref: -99 pid: 15607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787808.152056:0:15607:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff919052f5f800/0xe2c2ff68a6e856fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e85701 expref: -99 pid: 15607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1785787808.152522:0:15607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1785787808.153503:0:15607:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1785787808.153936:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1785787808.153983:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1785787808.154021:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1785787808.154070:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1785787808.154108:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1785787808.154145:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1785787808.154211:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1785787808.154221:0:15607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1785787808.154290:0:15607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd91f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:15607:1872533770054272:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1785787808.154505:0:15607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787808.154547:0:15607:0:(client.c:2702:ptlrpc_set_wait()) set ffff919076bb0240 going to sleep for 11 seconds 00000100:00100000:3.0:1785787808.154597:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770054272 00000100:00100000:3.0:1785787808.154602:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770054272 00000100:00100000:3.0:1785787808.154642:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1785787808.154651:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905fafb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+17:15607:x1872533770054272:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1785787808.155890:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905fafb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+17:15607:x1872533770054272:12345-0@lo:501:mount.lustre.0 Request processed in 1238us (1439us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787808.155899:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1785787808.155974:0:15607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd91f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:15607:1872533770054272:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1785787808.156007:0:15607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd91f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:15607:1872533770054400:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1785787808.156049:0:15607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787808.156079:0:15607:0:(client.c:2702:ptlrpc_set_wait()) set ffff919076bb0240 going to sleep for 11 seconds 00000100:00100000:2.0:1785787808.156136:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770054400 00000100:00100000:2.0:1785787808.156141:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770054400 00000100:00100000:2.0:1785787808.156211:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1785787808.156219:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+17:15607:x1872533770054400:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1785787808.156665:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+17:15607:x1872533770054400:12345-0@lo:503:mount.lustre.0 Request processed in 446us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787808.156672:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1785787808.156731:0:15607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd91f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:15607:1872533770054400:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1785787808.157194:0:15607:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1785787808.157244:0:15607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd91f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:15607:1872533770054528:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1785787808.157277:0:15607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787808.161271:0:15607:0:(client.c:2702:ptlrpc_set_wait()) set ffff919076bb0240 going to sleep for 11 seconds 00000100:00100000:0.0:1785787808.164723:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770054528 00000100:00100000:0.0:1785787808.164737:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770054528 00000100:00100000:0.0:1785787808.165366:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1785787808.165376:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905fafb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+17:15607:x1872533770054528:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1785787808.165669:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905fafb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+17:15607:x1872533770054528:12345-0@lo:502:mount.lustre.0 Request processed in 294us (8390us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787808.165677:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1785787808.166765:0:15607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd91f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:15607:1872533770054528:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1785787808.167110:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1785787808.167184:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1785787808.167223:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1785787808.167275:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1785787808.167319:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1785787808.167357:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1785787808.167409:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1785787808.167451:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1785787808.167628:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1785787808.167667:0:15607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd91f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:15607:1872533770054656:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1785787808.167717:0:15607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787808.167759:0:15607:0:(client.c:2702:ptlrpc_set_wait()) set ffff919076bb0240 going to sleep for 11 seconds 00000100:00100000:2.0:1785787808.167962:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770054656 00000100:00100000:2.0:1785787808.167968:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770054656 00000100:00100000:2.0:1785787808.168010:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1785787808.168017:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+17:15607:x1872533770054656:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1785787808.168193:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+17:15607:x1872533770054656:12345-0@lo:502:mount.lustre.0 Request processed in 169us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787808.168202:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1785787808.170700:0:15607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd91f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:15607:1872533770054656:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1785787808.170813:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1785787808.170853:0:15607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1785787808.172558:0:15609:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1785787808.172567:0:15609:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1785787808.172572:0:15609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785787808.172574:0:15609:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1785787808.172580:0:15609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1785787808.172613:0:15609:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff919077a93380) 00000020:00000080:3.0:1785787808.172636:0:15609:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1785787808.172642:0:15609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1785787808.172696:0:15609:0:(tgt_mount.c:153:server_get_mount()) get mount ffff919077aad800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1785787808.172708:0:15609:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1785787808.172714:0:15609:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe2c2ff68a6e8570f 00010000:00010000:3.0:1785787808.175516:0:15609:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000100:00100000:2.0:1785787808.181273:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785787808.181297:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770054784:0@lo:13:osp-pre-0-0.0 00000001:00000004:3.0:1785787808.181303:0:15609:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00000100:00100000:2.0:1785787808.181384:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787808.181426:0:14941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770054784 00000100:00100000:2.0:1785787808.181434:0:14941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770054784 00000100:00080000:1.0:1785787808.181583:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1785787808.181597:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1785787808.181601:0:37:0:(import.c:65:import_set_state_nolock()) ffff91905fad9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1785787808.181606:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 590 00000100:00080000:1.0:1785787808.181610:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1785787808.181615:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91905fad9800 using connection 192.168.203.153@tcp/0@lo 00000100:00100000:1.0:1785787808.181638:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91907fd91f80 x1872533770054912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1785787808.181736:0:3332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3332:1872533770054912:0@lo:8:kworker.0 00000100:00100000:0.0:1785787808.181773:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787808.181820:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785787808.181850:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3335:1872533770055040:0@lo:400:kworker.0 00000100:00100000:0.0:1785787808.181882:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787808.181910:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770055040 00000100:00100000:0.0:1785787808.181914:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770055040 00000100:00100000:0.0:1785787808.181952:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1785787808.181961:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41390e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3335:x1872533770055040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787808.182016:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41390e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3335:x1872533770055040:12345-0@lo:400:kworker.0 Request processed in 56us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787808.182023:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1785787808.182072:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91907fd90e00 x1872533770055040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787808.182098:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3335:1872533770055040:0@lo:400:kworker.0 00000100:00100000:1.0:1785787808.182222:0:14939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770054912 00000100:00100000:1.0:1785787808.182226:0:14939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770054912 00000100:00100000:1.0:1785787808.182255:0:14939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1785787808.182261:0:14939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41391f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3332:x1872533770054912:12345-0@lo:8:kworker.0 00010000:02000000:1.0:1785787808.182283:0:14939:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-OST0001: Not available for connect from 0@lo (not set up) 00000100:00100000:2.0:1785787808.183279:0:14941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1785787808.183290:0:14941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770054784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785787808.183322:0:14941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785787808.183372:0:14941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770054784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (1987us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787808.183380:0:14941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1785787808.183424:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770054784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785787808.183447:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3333:1872533770055168:0@lo:400:kworker.0 00000100:00100000:2.0:1785787808.183473:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1785787808.183504:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785787808.183527:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770055168 00000100:00100000:2.0:1785787808.183532:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770055168 00000100:00100000:2.0:1785787808.183566:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1785787808.183576:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1872533770055168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787808.183636:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1872533770055168:12345-0@lo:400:kworker.0 Request processed in 63us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787808.183644:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1785787808.183660:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1785787808.183678:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91907fd92680 x1872533770055168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787808.183689:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3333:1872533770055168:0@lo:400:kworker.0 00080000:10000000:3.0:1785787808.184125:0:15609:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1785787808.186520:0:15609:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1785787808.186529:0:15609:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785787808.186533:0:15609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785787808.186535:0:15609:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1785787808.186537:0:15609:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1785787808.186539:0:15609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785787808.186540:0:15609:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1785787808.186542:0:15609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1785787808.186543:0:15609:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1785787808.186544:0:15609:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785787808.186546:0:15609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785787808.186546:0:15609:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1785787808.186548:0:15609:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1785787808.186549:0:15609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785787808.186550:0:15609:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1785787808.186552:0:15609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1785787808.186603:0:15609:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785787808.186606:0:15609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785787808.186608:0:15609:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1785787808.186611:0:15609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1785787808.186767:0:15607:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1785787808.186793:0:15607:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1785787808.186808:0:15607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff919052f5f800/0xe2c2ff68a6e856fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e85701 expref: -99 pid: 15607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787808.186819:0:15607:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff919052f5f800/0xe2c2ff68a6e856fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e85701 expref: -99 pid: 15607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785787808.186970:0:15607:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff919077aad800 from 1 10000000:01000000:2.0:1785787808.186973:0:15607:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1785787808.187004:0:15607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff91904677d400/0xe2c2ff68a6e85716 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787808.187013:0:15607:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff91904677d400/0xe2c2ff68a6e85716 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787808.187024:0:15607:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff91904677d400/0xe2c2ff68a6e85716 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787808.187055:0:15607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:15607:1872533770055296:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1785787808.187158:0:15607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787808.187191:0:15607:0:(client.c:2702:ptlrpc_set_wait()) set ffff919046e0f600 going to sleep for 11 seconds 00000100:00100000:0.0:1785787808.188107:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770055296 00000100:00100000:0.0:1785787808.188116:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770055296 00000100:00100000:0.0:1785787808.188159:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1785787808.188167:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+17:15607:x1872533770055296:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1785787808.188180:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787808.188193:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919052f5f000/0xe2c2ff68a6e8571d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e85716 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787808.188216:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919052f5f000/0xe2c2ff68a6e8571d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e85716 expref: 18 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787808.188227:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919052f5f000/0xe2c2ff68a6e8571d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e85716 expref: 18 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787808.188235:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919052f5f000, rc 0) 00000100:00100000:0.0:1785787808.188283:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+18:15607:x1872533770055296:12345-0@lo:101:mount.lustre.0 Request processed in 117us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787808.188289:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1785787808.188294:0:15607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:15607:1872533770055296:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1785787808.188307:0:15607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff91904677d400/0xe2c2ff68a6e85716 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e8571d expref: -99 pid: 15607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787808.188317:0:15607:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff91904677d400/0xe2c2ff68a6e85716 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e8571d expref: -99 pid: 15607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785787808.188701:0:15607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000100:00100000:1.0:1785787808.189057:0:14939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41391f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3332:x1872533770054912:12345-0@lo:8:kworker.0 Request processed in 6793us (7283us total) trans 0 rc -19/-19 00000100:00100000:1.0:1785787808.189067:0:14939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000040:00080000:2.0:1785787808.189263:0:15607:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1785787808.189465:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1785787808.189507:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1785787808.189574:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1785787808.189581:0:15607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00080000:0.0:1785787808.189725:0:3332:0:(import.c:65:import_set_state_nolock()) ffff91905fad9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1785787808.189731:0:3332:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1785787808.189734:0:3332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3332:1872533770054912:0@lo:8:kworker.0 00000100:00100000:2.0:1785787808.189819:0:15607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:15607:1872533770055424:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785787808.190173:0:15607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787808.190235:0:15607:0:(client.c:2702:ptlrpc_set_wait()) set ffff919046e0f600 going to sleep for 11 seconds 00000100:00100000:3.0:1785787808.191219:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770055424 00000100:00100000:3.0:1785787808.191226:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770055424 00000100:00100000:3.0:1785787808.191262:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1785787808.191270:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905fafbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+18:15607:x1872533770055424:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1785787808.191472:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905fafbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+18:15607:x1872533770055424:12345-0@lo:501:mount.lustre.0 Request processed in 202us (1298us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787808.191480:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1785787808.191609:0:15607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:15607:1872533770055424:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1785787808.191648:0:15607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd91f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:15607:1872533770055552:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1785787808.191688:0:15607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787808.191721:0:15607:0:(client.c:2702:ptlrpc_set_wait()) set ffff919076bb0240 going to sleep for 11 seconds 00000100:00100000:0.0:1785787808.191777:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770055552 00000100:00100000:0.0:1785787808.191782:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770055552 00000100:00100000:0.0:1785787808.191814:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1785787808.191821:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905fafa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+18:15607:x1872533770055552:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1785787808.192186:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905fafa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+18:15607:x1872533770055552:12345-0@lo:503:mount.lustre.0 Request processed in 363us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787808.192193:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1785787808.192248:0:15607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd91f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:15607:1872533770055552:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1785787808.192620:0:15607:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1785787808.192671:0:15607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd91f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:15607:1872533770055680:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1785787808.192703:0:15607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787808.192732:0:15607:0:(client.c:2702:ptlrpc_set_wait()) set ffff919076bb0240 going to sleep for 11 seconds 00000100:00100000:2.0:1785787808.192780:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770055680 00000100:00100000:2.0:1785787808.192785:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770055680 00000100:00100000:2.0:1785787808.192975:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1785787808.192983:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91906ef7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+18:15607:x1872533770055680:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1785787808.193144:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91906ef7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+18:15607:x1872533770055680:12345-0@lo:502:mount.lustre.0 Request processed in 161us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787808.193151:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1785787808.193217:0:15607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd91f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:15607:1872533770055680:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1785787808.193400:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1785787808.193438:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1785787808.193481:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1785787808.193519:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1785787808.193547:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1785787808.193600:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1785787808.193638:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1785787808.193673:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1785787808.193694:0:15607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd91f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:15607:1872533770055808:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1785787808.193725:0:15607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787808.193753:0:15607:0:(client.c:2702:ptlrpc_set_wait()) set ffff919076bb0240 going to sleep for 11 seconds 00000100:00100000:0.0:1785787808.193814:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770055808 00000100:00100000:0.0:1785787808.193819:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770055808 00000100:00100000:0.0:1785787808.194006:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1785787808.194013:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076f19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+18:15607:x1872533770055808:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1785787808.194124:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076f19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+18:15607:x1872533770055808:12345-0@lo:502:mount.lustre.0 Request processed in 111us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787808.194136:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1785787808.194173:0:15607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd91f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:15607:1872533770055808:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1785787808.194245:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1785787808.194255:0:15607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1785787808.194816:0:15613:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785787808.194824:0:15613:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785787808.194857:0:15613:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1785787808.194864:0:15613:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff919077aad800 00000020:00000080:0.0:1785787808.194867:0:15613:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1785787808.194873:0:15613:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785787808.194876:0:15613:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785787808.194877:0:15613:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1785787808.194880:0:15613:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785787808.194883:0:15613:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785787808.194884:0:15613:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1785787808.194887:0:15613:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff919077aad800 00000020:00000080:0.0:1785787808.194889:0:15613:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1785787808.194930:0:15613:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785787808.194934:0:15613:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785787808.194935:0:15613:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1785787808.194943:0:15613:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785787808.194946:0:15613:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785787808.194948:0:15613:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1785787808.194951:0:15613:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff919077aad800 00000020:00000080:0.0:1785787808.194953:0:15613:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1785787808.194989:0:15613:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785787808.194993:0:15613:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785787808.194994:0:15613:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1785787808.194997:0:15613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1785787808.195095:0:15607:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1785787808.195115:0:15607:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1785787808.195132:0:15607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff91904677d400/0xe2c2ff68a6e85716 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e8571d expref: -99 pid: 15607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787808.195142:0:15607:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff91904677d400/0xe2c2ff68a6e85716 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e8571d expref: -99 pid: 15607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785787808.195176:0:15607:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1785787808.195179:0:15607:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff919077aad800 10000000:01000000:2.0:1785787808.195181:0:15607:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff919077aad800 10000000:01000000:2.0:1785787808.195185:0:15607:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1785787808.195190:0:15607:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff919077aad800 from 1 10000000:01000000:2.0:1785787808.195193:0:15607:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1785787808.195216:0:15607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff91904677d200/0xe2c2ff68a6e85724 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787808.195224:0:15607:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff91904677d200/0xe2c2ff68a6e85724 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787808.195233:0:15607:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff91904677d200/0xe2c2ff68a6e85724 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787808.195245:0:15607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:15607:1872533770055936:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1785787808.195273:0:15607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787808.195298:0:15607:0:(client.c:2702:ptlrpc_set_wait()) set ffff919046e0fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1785787808.198715:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770055936 00000100:00100000:3.0:1785787808.198727:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770055936 00000100:00100000:3.0:1785787808.198780:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1785787808.198790:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076f18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+18:15607:x1872533770055936:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1785787808.198806:0:14294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787808.198823:0:14294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91905f902800/0xe2c2ff68a6e8572b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e85724 expref: -99 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787808.198877:0:14294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91905f902800/0xe2c2ff68a6e8572b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e85724 expref: 19 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787808.198888:0:14294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91905f902800/0xe2c2ff68a6e8572b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e85724 expref: 19 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787808.198897:0:14294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f902800, rc 0) 00000100:00100000:3.0:1785787808.198964:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076f18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+19:15607:x1872533770055936:12345-0@lo:101:mount.lustre.0 Request processed in 176us (3689us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787808.198972:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1785787808.198984:0:15607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:15607:1872533770055936:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1785787808.199004:0:15607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff91904677d200/0xe2c2ff68a6e85724 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e8572b expref: -99 pid: 15607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787808.199026:0:15607:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff91904677d200/0xe2c2ff68a6e85724 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e8572b expref: -99 pid: 15607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785787808.199563:0:15607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1785787808.200040:0:15607:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1785787808.200282:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1785787808.200337:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1785787808.200374:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1785787808.200417:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1785787808.200453:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1785787808.200507:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1785787808.200546:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1785787808.200602:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1785787808.200662:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1785787808.200698:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1785787808.200731:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1785787808.200774:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1785787808.200816:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1785787808.200882:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1785787808.200957:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1785787808.201012:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1785787808.201079:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1785787808.201133:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1785787808.201165:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1785787808.201196:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1785787808.201253:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1785787808.201294:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1785787808.201337:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1785787808.201394:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1785787808.201425:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1785787808.201466:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1785787808.201543:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1785787808.201607:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1785787808.201662:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1785787808.201730:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1785787808.201782:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1785787808.201848:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1785787808.201919:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1785787808.201999:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1785787808.202054:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1785787808.202118:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1785787808.202172:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1785787808.202275:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1785787808.202283:0:15607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1785787808.202360:0:15607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:15607:1872533770056064:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785787808.202416:0:15607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787808.202459:0:15607:0:(client.c:2702:ptlrpc_set_wait()) set ffff919046e0fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1785787808.206200:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770056064 00000100:00100000:0.0:1785787808.206213:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770056064 00000100:00100000:0.0:1785787808.206269:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1785787808.206278:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076f1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+19:15607:x1872533770056064:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1785787808.206551:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076f1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+19:15607:x1872533770056064:12345-0@lo:501:mount.lustre.0 Request processed in 274us (4133us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787808.206559:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1785787808.209057:0:15607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:15607:1872533770056064:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785787808.209108:0:15607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:15607:1872533770056192:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1785787808.209168:0:15607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787808.209205:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770056192 00000100:00100000:2.0:1785787808.209210:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770056192 00000100:00100000:2.0:1785787808.209247:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1785787808.209255:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076f18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+19:15607:x1872533770056192:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1785787808.209544:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076f18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+19:15607:x1872533770056192:12345-0@lo:503:mount.lustre.0 Request processed in 289us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787808.209552:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1785787808.209610:0:15607:0:(client.c:2702:ptlrpc_set_wait()) set ffff919046e0fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1785787808.209621:0:15607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:15607:1872533770056192:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1785787808.212036:0:15607:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1785787808.212116:0:15607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:15607:1872533770056320:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1785787808.212173:0:15607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787808.212214:0:15607:0:(client.c:2702:ptlrpc_set_wait()) set ffff919046e0fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1785787808.212366:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770056320 00000100:00100000:3.0:1785787808.212374:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770056320 00000100:00100000:3.0:1785787808.212422:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1785787808.212432:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076f19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+19:15607:x1872533770056320:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1785787808.212738:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076f19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+19:15607:x1872533770056320:12345-0@lo:502:mount.lustre.0 Request processed in 308us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787808.212746:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1785787808.214184:0:15607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:15607:1872533770056320:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1785787808.214781:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1785787808.214849:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1785787808.214898:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1785787808.214952:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1785787808.214988:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1785787808.215034:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1785787808.215067:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1785787808.215114:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1785787808.215157:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1785787808.215188:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1785787808.215219:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1785787808.215262:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1785787808.215297:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1785787808.216484:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1785787808.216546:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1785787808.216574:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1785787808.217044:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1785787808.217103:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1785787808.217140:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1785787808.217176:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1785787808.217228:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1785787808.217265:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1785787808.217313:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1785787808.217376:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1785787808.217414:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1785787808.217460:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1785787808.217511:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1785787808.217545:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1785787808.217577:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1785787808.217663:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1785787808.217712:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1785787808.217756:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1785787808.217795:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1785787808.217961:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1785787808.219614:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1785787808.219706:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1785787808.219752:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1785787808.219782:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1785787808.219839:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1785787808.219904:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1785787808.219958:0:15607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:15607:1872533770056448:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1785787808.220026:0:15607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787808.220250:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770056448 00000100:00100000:0.0:1785787808.220257:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770056448 00000100:00100000:0.0:1785787808.220299:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1785787808.220307:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076f1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+19:15607:x1872533770056448:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1785787808.220552:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076f1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+19:15607:x1872533770056448:12345-0@lo:502:mount.lustre.0 Request processed in 245us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787808.220560:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1785787808.220619:0:15607:0:(client.c:2702:ptlrpc_set_wait()) set ffff919046e0fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1785787808.220639:0:15607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:15607:1872533770056448:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1785787808.220696:0:15607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1785787808.220704:0:15607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1785787808.221545:0:15618:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1785787808.221564:0:15618:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff91905d4a3380) 00000020:00000080:1.0:1785787808.221582:0:15618:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1785787808.221740:0:15618:0:(tgt_mount.c:153:server_get_mount()) get mount ffff919077aad800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1785787808.221744:0:15618:0:(tgt_mount.c:187:server_put_mount()) put mount ffff919077aad800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1785787808.221747:0:15618:0:(obd_mount.c:710:lustre_put_lsi()) put ffff919077aad800 3 00010000:00080000:1.0:1785787808.221771:0:15618:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91905430b000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.153@tcp at head 00010000:00010000:1.0:1785787808.224200:0:15618:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1785787808.224282:0:15618:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1785787808.224309:0:15618:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1785787808.224327:0:15618:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xe2c2ff68a6e85739 00000100:00080000:1.0:1785787808.224335:0:15618:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1785787808.224340:0:15618:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff91905430b000 using connection 192.168.203.153@tcp/0@lo 00000100:00100000:1.0:1785787808.224369:0:15618:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91907fd92680 x1872533770056576/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1785787808.224394:0:15618:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1785787808.224582:0:3332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1872533770056576:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1785787808.224644:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1785787808.226388:0:15618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:2.0:1785787808.227168:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770056576 00000100:00100000:2.0:1785787808.227176:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770056576 00000100:00100000:2.0:1785787808.227273:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1785787808.227281:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41393b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3332:x1872533770056576:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1785787808.227281:0:14302:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1785787808.227292:0:14302:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00080000:2.0:1785787808.227309:0:14303:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 595 last 0 00000020:00000080:2.0:1785787808.227352:0:14303:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xe2c2ff68a6e85740 00000004:00100000:2.0:1785787808.227367:0:14303:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1785787808.227399:0:14303:0:(import.c:65:import_set_state_nolock()) ffff91907793e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1785787808.228171:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41393b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3332:x1872533770056576:12345-0@lo:38:llog_process_th.0 Request processed in 887us (3523us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787808.228180:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000000:2.0:1785787808.228260:0:15607:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1785787808.228289:0:15607:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1785787808.228307:0:15607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff91904677d200/0xe2c2ff68a6e85724 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e8572b expref: -99 pid: 15607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787808.228319:0:15607:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff91904677d200/0xe2c2ff68a6e85724 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e8572b expref: -99 pid: 15607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1785787808.228365:0:15607:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1785787808.228367:0:15607:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1785787808.228369:0:15607:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1785787808.228370:0:15607:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1785787808.228371:0:15607:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1785787808.228373:0:15607:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1785787808.228374:0:15607:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1785787808.228377:0:15607:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1785787808.228378:0:15607:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1785787808.228382:0:15607:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1785787808.228385:0:15607:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1785787808.228386:0:15607:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1785787808.228387:0:15607:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1785787808.228389:0:15607:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1785787808.228390:0:15607:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1785787808.228391:0:15607:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1785787808.228392:0:15607:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1785787808.228394:0:15607:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1785787808.228395:0:15607:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1785787808.228413:0:15607:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1785787808.228427:0:15607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:15607:1872533770056704:0@lo:253:mount.lustre.0 00010000:00080000:0.0:1785787808.228606:0:3332:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91907fd92680 x1872533770056576/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1785787818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787808.228617:0:3332:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1785787808.228630:0:3332:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1785787808.228637:0:3332:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1785787808.228641:0:3332:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1785787808.228644:0:3332:0:(import.c:65:import_set_state_nolock()) ffff91905430b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1785787808.228650:0:3332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3332:1872533770056576:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1785787808.228778:0:15607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787808.228805:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770056704 00000100:00100000:2.0:1785787808.228815:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770056704 00000100:00100000:2.0:1785787808.228866:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1785787808.228874:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076f1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+19:15607:x1872533770056704:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1785787808.228903:0:14296:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1785787808.228914:0:14296:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1785787808.229383:0:15607:0:(client.c:2702:ptlrpc_set_wait()) set ffff919046e0f300 going to sleep for 11 seconds 20000000:01000000:1.0:1785787808.271373:0:14296:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1785787808.271421:0:14296:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1785787808.272057:0:14317:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1785787808.272062:0:14317:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1785787808.272081:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91905f903a00/0xe2c2ff68a6e85747 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787808.272113:0:14317:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91904677d600/0xe2c2ff68a6e8561a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e85613 expref: 19 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787808.272122:0:14317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91905f903a00/0xe2c2ff68a6e85747 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787808.272163:0:14317:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91904677d600/0xe2c2ff68a6e8561a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2c2ff68a6e85613 expref: 19 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787808.272176:0:14317:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91904677d600/0xe2c2ff68a6e8561a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2c2ff68a6e85613 expref: 19 pid: 14294 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787808.272190:0:14317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076d88a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14317:1872533770056832:0@lo:104: 00000100:00100000:3.0:1785787808.272248:0:14317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787808.272285:0:14317:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190491e76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785787808.272634:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770056832 00000100:00100000:2.0:1785787808.272642:0:14284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770056832 00000100:00100000:2.0:1785787808.272687:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1785787808.272696:0:14284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076d88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f9a1da20-2955-44fa-b075-f73628199db8+3:14317:x1872533770056832:12345-0@lo:104: 00010000:00010000:2.0:1785787808.272708:0:14284:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff919052f5f600/0xe2c2ff68a6e85613 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e8561a expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787808.272759:0:14284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1785787808.272765:0:14284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076d88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f9a1da20-2955-44fa-b075-f73628199db8+3:14317:x1872533770056832:12345-0@lo:104: Request processed in 70us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787808.272772:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1785787808.272811:0:14317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076d88a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14317:1872533770056832:0@lo:104: 00010000:00010000:2.0:1785787808.272844:0:14317:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91905f903a00/0xe2c2ff68a6e85747 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787808.272888:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785787808.272894:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff919052f5f600/0xe2c2ff68a6e85613 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e8561a expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787808.272902:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919052f5f600 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:1.0:1785787808.272906:0:14289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff919052f5f600/0xe2c2ff68a6e85613 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2c2ff68a6e8561a expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787808.272914:0:14289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff919052f5f600/0xe2c2ff68a6e85613 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2c2ff68a6e8561a expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785787808.272932:0:14289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff919052f5f600/0xe2c2ff68a6e85613 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2c2ff68a6e8561a expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785787808.272937:0:14289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1785787808.273186:0:14289:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff919052f5f600/0xe2c2ff68a6e85613 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e8561a expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787808.273194:0:14289:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785787808.273214:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff919052f5f600/0xe2c2ff68a6e85613 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e8561a expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787808.273221:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff919052f5f600/0xe2c2ff68a6e85613 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e8561a expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787808.273226:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9a1da20-2955-44fa-b075-f73628199db8:3334:1872533770056960:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785787808.273235:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787808.273237:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787808.273238:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787808.273256:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787808.273310:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770056960 00000100:00100000:1.0:1785787808.273315:0:14286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770056960 00010000:00010000:1.0:1785787808.273333:0:14286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91904677d600/0xe2c2ff68a6e8561a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e85613 expref: 20 pid: 14294 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787808.273357:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1785787808.273363:0:14286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41392d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9a1da20-2955-44fa-b075-f73628199db8+20:3334:x1872533770056960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785787808.273372:0:14286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785787808.273377:0:14286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91904677d600/0xe2c2ff68a6e8561a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e85613 expref: 20 pid: 14294 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787808.273387:0:14286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91904677d600/0xe2c2ff68a6e8561a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2c2ff68a6e85613 expref: 20 pid: 14294 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787808.273406:0:14286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91904677d600/0xe2c2ff68a6e8561a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2c2ff68a6e85613 expref: 20 pid: 14294 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787808.273419:0:14286:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91905f903a00/0xe2c2ff68a6e85747 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787808.273427:0:14286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91905f903a00/0xe2c2ff68a6e85747 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1785787808.273438:0:14286:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007868653s 00010000:00010000:1.0:1785787808.273442:0:14286:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91905f903a00/0xe2c2ff68a6e85747 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787808.273460:0:14286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91905f903a00/0xe2c2ff68a6e85747 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787808.273467:0:14286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91905f903a00/0xe2c2ff68a6e85747 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787808.273474:0:14286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91905f903a00/0xe2c2ff68a6e85747 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787808.273479:0:14286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903a00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785787808.273483:0:14286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91905f903a00/0xe2c2ff68a6e85747 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787808.273490:0:14286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91905f903a00/0xe2c2ff68a6e85747 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787808.273500:0:14286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91905f903a00/0xe2c2ff68a6e85747 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787808.273519:0:14286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785787808.273558:0:14286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41392d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9a1da20-2955-44fa-b075-f73628199db8+19:3334:x1872533770056960:12345-0@lo:103:ldlm_bl.0 Request processed in 195us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787808.273565:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1785787808.273632:0:14317:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91905f903a00/0xe2c2ff68a6e85747 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787808.273641:0:14317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91905f903a00/0xe2c2ff68a6e85747 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787808.273647:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91905f903a00/0xe2c2ff68a6e85747 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787808.273730:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9a1da20-2955-44fa-b075-f73628199db8:3334:1872533770056960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785787808.276876:0:15607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9a1da20-2955-44fa-b075-f73628199db8:15607:1872533770056704:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1785787808.276880:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076f1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+18:15607:x1872533770056704:12345-0@lo:253:mount.lustre.0 Request processed in 48006us (48101us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787808.276891:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 10000000:01000000:2.0:1785787808.276891:0:15607:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1785787808.276894:0:15607:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1785787808.276896:0:15607:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1785787808.276897:0:15607:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1785787808.276898:0:15607:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1785787808.276900:0:15607:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1785787808.276901:0:15607:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1785787808.276903:0:15607:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1785787808.276916:0:15607:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1785787808.276918:0:15607:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1785787808.276934:0:15607:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1785787808.281445:0:15607:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1785787808.281617:0:15607:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1785787808.281757:0:15607:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1785787808.281922:0:15607:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1785787808.282073:0:15607:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1785787808.282279:0:15607:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1785787808.283612:0:15607:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1785787808.321927:0:15607:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1785787808.321936:0:15607:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1785787808.321967:0:15607:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1785787808.322021:0:15607:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.153@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1785787808.322047:0:15607:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1785787808.322073:0:15607:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1785787808.756635:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787809.780062:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1785787809.979855:0:14298:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1785787809.979863:0:14298:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff91905f91f800 from 8 10000000:01000000:1.0:1785787809.979868:0:14298:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1785787809.979950:0:14298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff9190443c5a00/0xe2c2ff68a6e8574e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787809.979962:0:14298:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff9190443c5a00/0xe2c2ff68a6e8574e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787809.979972:0:14298:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff9190443c5a00/0xe2c2ff68a6e8574e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787809.979997:0:14298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd93480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9a1da20-2955-44fa-b075-f73628199db8:14298:1872533770057088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1785787809.980063:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787809.980110:0:14298:0:(client.c:2702:ptlrpc_set_wait()) set ffff919076bb0300 going to sleep for 11 seconds 00000100:00100000:0.0:1785787809.980704:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770057088 00000100:00100000:0.0:1785787809.980712:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770057088 00000100:00100000:0.0:1785787809.980753:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1785787809.980762:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076f1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+18:14298:x1872533770057088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785787809.980775:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787809.980788:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919052f5ea00/0xe2c2ff68a6e85755 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e8574e expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787809.980809:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919052f5ea00/0xe2c2ff68a6e85755 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e8574e expref: 19 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787809.980819:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919052f5ea00/0xe2c2ff68a6e85755 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e8574e expref: 19 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787809.980843:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919052f5ea00, rc 0) 00000100:00100000:0.0:1785787809.980894:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076f1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+19:14298:x1872533770057088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787809.980901:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1785787809.981698:0:14298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd93480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9a1da20-2955-44fa-b075-f73628199db8:14298:1872533770057088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785787809.981715:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff9190443c5a00/0xe2c2ff68a6e8574e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e85755 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787809.981723:0:14298:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff9190443c5a00/0xe2c2ff68a6e8574e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e85755 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787809.981786:0:14298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076d8b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9a1da20-2955-44fa-b075-f73628199db8:14298:1872533770057216:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1785787809.981823:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787809.981876:0:14298:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905c4c2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1785787809.981899:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770057216 00000100:00100000:0.0:1785787809.981904:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770057216 00000100:00100000:0.0:1785787809.981937:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1785787809.981944:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076f18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+19:14298:x1872533770057216:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1785787809.981960:0:14296:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1785787809.981975:0:14296:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1785787809.981979:0:14296:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1785787809.982062:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076f18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+19:14298:x1872533770057216:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 117us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787809.982069:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1785787809.982191:0:14298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076d8b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9a1da20-2955-44fa-b075-f73628199db8:14298:1872533770057216:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1785787809.982243:0:14298:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1785787809.982250:0:14298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff9190443c5a00/0xe2c2ff68a6e8574e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e85755 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787809.982257:0:14298:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff9190443c5a00/0xe2c2ff68a6e8574e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e85755 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787810.802947:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787811.834915:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787812.851012:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1785787813.298995:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1785787813.299002:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1785787813.299005:0:37:0:(import.c:65:import_set_state_nolock()) ffff91905fad9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1785787813.299012:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 595 00000100:00080000:2.0:1785787813.299016:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1785787813.299022:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91905fad9800 using connection 192.168.203.153@tcp/0@lo 00000100:00100000:2.0:1785787813.299038:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91907764e680 x1872533770057600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1785787813.299091:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9a1da20-2955-44fa-b075-f73628199db8:3335:1872533770057344:0@lo:400:kworker.0 00000100:00100000:2.0:1785787813.299164:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787813.299214:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3335:1872533770057984:0@lo:400:kworker.0 00000100:00100000:2.0:1785787813.299239:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787813.299259:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785787813.299263:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770057472:0@lo:400:kworker.0 00000100:00100000:2.0:1785787813.299282:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787813.299305:0:3332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3332:1872533770057600:0@lo:8:kworker.0 00000100:00100000:2.0:1785787813.299329:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787813.299350:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1872533770057728:0@lo:400:kworker.0 00000100:00100000:2.0:1785787813.299376:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787813.299389:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785787813.299392:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3333:1872533770057856:0@lo:400:kworker.0 00000100:00100000:2.0:1785787813.299409:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787813.299443:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770057344 00000100:00100000:2.0:1785787813.299448:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770057344 00000100:00100000:2.0:1785787813.299483:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1785787813.299490:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076f18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+19:3335:x1872533770057344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787813.299528:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076f18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+19:3335:x1872533770057344:12345-0@lo:400:kworker.0 Request processed in 38us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787813.299534:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1785787813.299570:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770057984 00000100:00100000:2.0:1785787813.299573:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770057984 00000100:00100000:2.0:1785787813.299600:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770057728 00000100:00100000:2.0:1785787813.299602:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770057728 00000100:00100000:2.0:1785787813.299611:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770057856 00000100:00100000:2.0:1785787813.299613:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770057856 00000100:00100000:2.0:1785787813.299626:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1785787813.299631:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3335:x1872533770057984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787813.299671:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3335:x1872533770057984:12345-0@lo:400:kworker.0 Request processed in 40us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787813.299676:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1785787813.299685:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1785787813.299690:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1872533770057728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787813.299726:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1872533770057728:12345-0@lo:400:kworker.0 Request processed in 37us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787813.299731:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1785787813.299739:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1785787813.299744:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1872533770057856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787813.299779:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1872533770057856:12345-0@lo:400:kworker.0 Request processed in 36us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787813.299792:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1785787813.299809:0:14938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770057472 00000100:00100000:2.0:1785787813.299812:0:14938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770057472 00000100:00100000:2.0:1785787813.299853:0:14938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770057600 00000100:00100000:2.0:1785787813.299856:0:14938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770057600 00000100:00100000:2.0:1785787813.299866:0:14938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1785787813.299871:0:14938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533770057472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787813.299897:0:14938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533770057472:12345-0@lo:400:kworker.0 Request processed in 26us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787813.299902:0:14938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1785787813.299910:0:14938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1785787813.299913:0:14938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3332:x1872533770057600:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1785787813.299932:0:14938:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 600 last 0 00000020:00000080:2.0:1785787813.299954:0:14938:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe2c2ff68a6e8575c 00002000:00100000:2.0:1785787813.299965:0:14938:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff919077aac800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113801 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1785787813.299968:0:14938:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1785787813.299971:0:14938:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1785787813.300248:0:14938:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1785787813.300266:0:14938:0:(import.c:65:import_set_state_nolock()) ffff919077aa8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1785787813.300313:0:14938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3332:x1872533770057600:12345-0@lo:8:kworker.0 Request processed in 398us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787813.300319:0:14938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1785787813.300340:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1785787813.300343:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1785787813.300367:0:3332:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907764e680 x1872533770057600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1785787838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787813.300386:0:3332:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1785787813.300393:0:3332:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1785787813.300399:0:3332:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1785787813.300403:0:3332:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1785787813.300405:0:3332:0:(import.c:65:import_set_state_nolock()) ffff91905fad9800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1785787813.300414:0:3332:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1785787813.300419:0:3332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3332:1872533770057600:0@lo:8:kworker.0 00000004:00080000:2.0:1785787813.300452:0:14326:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:2.0:1785787813.300464:0:14326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bd9a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14326:1872533770058240:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1785787813.300486:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787813.300497:0:14326:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190482903c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785787813.300511:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bd99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770058112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785787813.300543:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787813.300578:0:14941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770058112 00000100:00100000:2.0:1785787813.300582:0:14941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770058112 00000100:00100000:2.0:1785787813.300607:0:14941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1785787813.300613:0:14941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3336:x1872533770058112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785787813.300630:0:14941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785787813.300663:0:14941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3336:x1872533770058112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787813.300668:0:14941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1785787813.300683:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1785787813.300697:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907bd99500 x1872533770058112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785787829 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787813.300710:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bd99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770058112:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1785787813.300740:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907764df80 x1872533770057856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787813.300749:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3333:1872533770057856:0@lo:400:kworker.0 00010000:00080000:2.0:1785787813.300758:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907764f100 x1872533770057728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787813.300765:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1872533770057728:0@lo:400:kworker.0 00000100:00100000:2.0:1785787813.300787:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770057472:0@lo:400:kworker.0 00000100:00100000:2.0:1785787813.300794:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9a1da20-2955-44fa-b075-f73628199db8:3335:1872533770057344:0@lo:400:kworker.0 00010000:00080000:2.0:1785787813.300803:0:3335:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907764ca80 x1872533770057984/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785787813.300811:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3335:1872533770057984:0@lo:400:kworker.0 00000100:00100000:2.0:1785787813.300845:0:14938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770058240 00000100:00100000:2.0:1785787813.300848:0:14938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770058240 00000100:00100000:2.0:1785787813.300871:0:14938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1785787813.300877:0:14938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14326:x1872533770058240:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1785787813.302711:0:14325:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1785787813.303095:0:14325:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 600547265504ns, next at 0ns, rc = 0 00000100:00100000:1.0:1785787813.307995:0:3334:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785787813.308021:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770058368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785787813.308088:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787813.308131:0:14941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770058368 00000100:00100000:1.0:1785787813.308139:0:14941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770058368 00000100:00100000:1.0:1785787813.308181:0:14941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1785787813.308189:0:14941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770058368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785787813.308222:0:14941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785787813.308265:0:14941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770058368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787813.308272:0:14941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1785787813.308318:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770058368:0@lo:13:osp-pre-0-0.0 00002000:00080000:2.0:1785787813.316662:0:14938:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1785787813.316671:0:14938:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1785787813.316676:0:14938:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:2.0:1785787813.347547:0:14938:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785787813.347573:0:14938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bab96d98/0xe2c2ff68a6e85763 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.347590:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=600s v=(0 0) 00010000:00010000:2.0:1785787813.347601:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785787813.347607:0:14938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bab96d98/0xe2c2ff68a6e85763 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.347623:0:14938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bab96d98/0xe2c2ff68a6e85763 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.347633:0:14938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bab96d98/0xe2c2ff68a6e85763 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.347640:0:14938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bab96d98/0xe2c2ff68a6e85763 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.347657:0:14938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785787813.347669:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785787813.347675:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bab96d98/0xe2c2ff68a6e85763 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.347682:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677c800 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785787813.347686:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bab96d98/0xe2c2ff68a6e85763 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.347694:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bab96d98/0xe2c2ff68a6e85763 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.347708:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bab96d98/0xe2c2ff68a6e85763 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.347727:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bab96d98/0xe2c2ff68a6e85763 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.347744:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787813.347747:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787813.347748:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1785787813.348350:0:14938:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785787813.348357:0:14938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a5afe15/0xe2c2ff68a6e8576a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.348365:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=600s v=(0 0) 00010000:00010000:2.0:1785787813.348368:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785787813.348373:0:14938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a5afe15/0xe2c2ff68a6e8576a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.348383:0:14938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a5afe15/0xe2c2ff68a6e8576a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.348390:0:14938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a5afe15/0xe2c2ff68a6e8576a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.348397:0:14938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a5afe15/0xe2c2ff68a6e8576a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.348412:0:14938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785787813.348419:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785787813.348428:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a5afe15/0xe2c2ff68a6e8576a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.348435:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677c200 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785787813.348439:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a5afe15/0xe2c2ff68a6e8576a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.348447:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a5afe15/0xe2c2ff68a6e8576a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.348458:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a5afe15/0xe2c2ff68a6e8576a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.348466:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a5afe15/0xe2c2ff68a6e8576a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.348478:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787813.348479:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787813.348481:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1785787813.350898:0:14938:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785787813.350908:0:14938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fda141e/0xe2c2ff68a6e85771 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.350922:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=600s v=(0 0) 00010000:00010000:2.0:1785787813.350926:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785787813.350932:0:14938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fda141e/0xe2c2ff68a6e85771 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.350954:0:14938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000fda141e/0xe2c2ff68a6e85771 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.350964:0:14938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fda141e/0xe2c2ff68a6e85771 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.350971:0:14938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000fda141e/0xe2c2ff68a6e85771 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.355130:0:14938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1785787813.356915:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785787813.356925:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000fda141e/0xe2c2ff68a6e85771 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787813.356938:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677c400 already unused, calling callback (ffffffffc174c300) 00010000:00010000:3.0:1785787813.356943:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000fda141e/0xe2c2ff68a6e85771 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787813.356954:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000fda141e/0xe2c2ff68a6e85771 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787813.356982:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000fda141e/0xe2c2ff68a6e85771 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787813.356989:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000fda141e/0xe2c2ff68a6e85771 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787813.357008:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787813.357010:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787813.357012:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1785787813.358517:0:14938:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785787813.358529:0:14938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007bd992d8/0xe2c2ff68a6e85778 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.358543:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=600s v=(0 0) 00010000:00010000:2.0:1785787813.358546:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785787813.358560:0:14938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007bd992d8/0xe2c2ff68a6e85778 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.358572:0:14938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007bd992d8/0xe2c2ff68a6e85778 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.358581:0:14938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007bd992d8/0xe2c2ff68a6e85778 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.358598:0:14938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007bd992d8/0xe2c2ff68a6e85778 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.358622:0:14938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1785787813.361577:0:14938:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785787813.361586:0:14938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015fb6ea8/0xe2c2ff68a6e8577f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.361599:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=600s v=(0 0) 00010000:00010000:2.0:1785787813.361603:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785787813.361608:0:14938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015fb6ea8/0xe2c2ff68a6e8577f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.361619:0:14938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015fb6ea8/0xe2c2ff68a6e8577f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.361628:0:14938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015fb6ea8/0xe2c2ff68a6e8577f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.361635:0:14938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015fb6ea8/0xe2c2ff68a6e8577f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.361655:0:14938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1785787813.361667:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1785787813.361667:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785787813.361672:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015fb6ea8/0xe2c2ff68a6e8577f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.361684:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677d000 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785787813.361688:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015fb6ea8/0xe2c2ff68a6e8577f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.361697:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015fb6ea8/0xe2c2ff68a6e8577f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.361713:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015fb6ea8/0xe2c2ff68a6e8577f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.361719:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015fb6ea8/0xe2c2ff68a6e8577f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.361735:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787813.361736:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787813.361738:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1785787813.365712:0:14938:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785787813.365726:0:14938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf7f15fa/0xe2c2ff68a6e85786 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.365742:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=600s v=(0 0) 00010000:00010000:2.0:1785787813.365746:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785787813.365752:0:14938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf7f15fa/0xe2c2ff68a6e85786 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.365765:0:14938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf7f15fa/0xe2c2ff68a6e85786 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.365780:0:14938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf7f15fa/0xe2c2ff68a6e85786 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.365788:0:14938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf7f15fa/0xe2c2ff68a6e85786 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.365810:0:14938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1785787813.365875:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785787813.365882:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf7f15fa/0xe2c2ff68a6e85786 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787813.365890:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677cc00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:3.0:1785787813.365895:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf7f15fa/0xe2c2ff68a6e85786 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787813.365904:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf7f15fa/0xe2c2ff68a6e85786 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787813.365917:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf7f15fa/0xe2c2ff68a6e85786 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787813.365924:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf7f15fa/0xe2c2ff68a6e85786 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787813.365950:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787813.365952:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787813.365954:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1785787813.371695:0:14938:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785787813.371707:0:14938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a5afe15/0xe2c2ff68a6e8578d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.371723:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=600s v=(0 0) 00010000:00010000:2.0:1785787813.371727:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785787813.371734:0:14938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a5afe15/0xe2c2ff68a6e8578d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.371747:0:14938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a5afe15/0xe2c2ff68a6e8578d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.371758:0:14938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a5afe15/0xe2c2ff68a6e8578d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.371766:0:14938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a5afe15/0xe2c2ff68a6e8578d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.371795:0:14938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785787813.371806:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785787813.371812:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a5afe15/0xe2c2ff68a6e8578d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.371819:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677c200 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785787813.371824:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a5afe15/0xe2c2ff68a6e8578d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.371857:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a5afe15/0xe2c2ff68a6e8578d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.371871:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a5afe15/0xe2c2ff68a6e8578d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.371878:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a5afe15/0xe2c2ff68a6e8578d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.371892:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787813.371893:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787813.371895:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1785787813.373811:0:14938:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785787813.373819:0:14938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bab96d98/0xe2c2ff68a6e85794 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.373842:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=600s v=(0 0) 00010000:00010000:2.0:1785787813.373851:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785787813.373856:0:14938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bab96d98/0xe2c2ff68a6e85794 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.373867:0:14938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bab96d98/0xe2c2ff68a6e85794 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.373875:0:14938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bab96d98/0xe2c2ff68a6e85794 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.373882:0:14938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bab96d98/0xe2c2ff68a6e85794 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.373897:0:14938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785787813.373905:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785787813.373909:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bab96d98/0xe2c2ff68a6e85794 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.373915:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677c800 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785787813.373919:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bab96d98/0xe2c2ff68a6e85794 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.373927:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bab96d98/0xe2c2ff68a6e85794 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.373938:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bab96d98/0xe2c2ff68a6e85794 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.373957:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bab96d98/0xe2c2ff68a6e85794 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.373971:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787813.373972:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787813.373973:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1785787813.377968:0:14938:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785787813.377978:0:14938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7c237a0/0xe2c2ff68a6e8579b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787813.378378:0:15809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787813.378381:0:15809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787813.378384:0:15809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787813.378470:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007bd992d8/0xe2c2ff68a6e85778 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787813.378481:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677d600 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785787813.378486:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007bd992d8/0xe2c2ff68a6e85778 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787813.378497:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007bd992d8/0xe2c2ff68a6e85778 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787813.378528:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007bd992d8/0xe2c2ff68a6e85778 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787813.378535:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007bd992d8/0xe2c2ff68a6e85778 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787813.378566:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787813.378567:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787813.378569:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787813.380446:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=600s v=(0 0) 00010000:00010000:2.0:1785787813.380453:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785787813.380461:0:14938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7c237a0/0xe2c2ff68a6e8579b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.380475:0:14938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7c237a0/0xe2c2ff68a6e8579b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.380483:0:14938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7c237a0/0xe2c2ff68a6e8579b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.380490:0:14938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7c237a0/0xe2c2ff68a6e8579b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785787813.384751:0:5843:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:2.0:1785787813.401294:0:14938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785787813.401318:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785787813.401333:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7c237a0/0xe2c2ff68a6e8579b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.401475:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677da00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785787813.401481:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7c237a0/0xe2c2ff68a6e8579b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.401493:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7c237a0/0xe2c2ff68a6e8579b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.401514:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7c237a0/0xe2c2ff68a6e8579b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.401522:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7c237a0/0xe2c2ff68a6e8579b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.401544:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787813.401547:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787813.401560:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1785787813.402273:0:14938:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785787813.402280:0:14938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a5afe15/0xe2c2ff68a6e857a2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.406074:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=600s v=(0 0) 00010000:00010000:2.0:1785787813.406083:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785787813.406092:0:14938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a5afe15/0xe2c2ff68a6e857a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.406129:0:14938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a5afe15/0xe2c2ff68a6e857a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.406139:0:14938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a5afe15/0xe2c2ff68a6e857a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.406145:0:14938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a5afe15/0xe2c2ff68a6e857a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.406184:0:14938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785787813.406196:0:15809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785787813.406200:0:15809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a5afe15/0xe2c2ff68a6e857a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.406206:0:15809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677c200 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785787813.406210:0:15809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a5afe15/0xe2c2ff68a6e857a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.406217:0:15809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a5afe15/0xe2c2ff68a6e857a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.406230:0:15809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a5afe15/0xe2c2ff68a6e857a2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.406236:0:15809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a5afe15/0xe2c2ff68a6e857a2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.406261:0:15809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787813.406263:0:15809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787813.406265:0:15809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1785787813.406948:0:14938:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785787813.406955:0:14938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015fb6ea8/0xe2c2ff68a6e857a9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.406963:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=600s v=(0 0) 00010000:00010000:2.0:1785787813.406966:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785787813.406970:0:14938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015fb6ea8/0xe2c2ff68a6e857a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.406980:0:14938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015fb6ea8/0xe2c2ff68a6e857a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.407101:0:14938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015fb6ea8/0xe2c2ff68a6e857a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.407110:0:14938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015fb6ea8/0xe2c2ff68a6e857a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.407131:0:14938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1785787813.409815:0:14938:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785787813.409839:0:14938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078014ab1/0xe2c2ff68a6e857b0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.409865:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=600s v=(0 0) 00010000:00010000:2.0:1785787813.409869:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785787813.409875:0:14938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078014ab1/0xe2c2ff68a6e857b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.409888:0:14938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078014ab1/0xe2c2ff68a6e857b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.409899:0:14938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078014ab1/0xe2c2ff68a6e857b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.409906:0:14938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078014ab1/0xe2c2ff68a6e857b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.409927:0:14938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1785787813.409941:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1785787813.409946:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015fb6ea8/0xe2c2ff68a6e857a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.409954:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677d000 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785787813.409959:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015fb6ea8/0xe2c2ff68a6e857a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.409967:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015fb6ea8/0xe2c2ff68a6e857a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.410435:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015fb6ea8/0xe2c2ff68a6e857a9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.410445:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015fb6ea8/0xe2c2ff68a6e857a9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.410463:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785787813.410467:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078014ab1/0xe2c2ff68a6e857b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.410473:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677ce00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785787813.410476:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078014ab1/0xe2c2ff68a6e857b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.410483:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078014ab1/0xe2c2ff68a6e857b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.410493:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078014ab1/0xe2c2ff68a6e857b0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.410500:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078014ab1/0xe2c2ff68a6e857b0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.410510:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787813.410512:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787813.410519:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1785787813.410941:0:14938:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785787813.410946:0:14938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf7f15fa/0xe2c2ff68a6e857b7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.410954:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=600s v=(0 0) 00010000:00010000:2.0:1785787813.410957:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785787813.410960:0:14938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf7f15fa/0xe2c2ff68a6e857b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.410968:0:14938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf7f15fa/0xe2c2ff68a6e857b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.410974:0:14938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf7f15fa/0xe2c2ff68a6e857b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.410980:0:14938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf7f15fa/0xe2c2ff68a6e857b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.411484:0:14938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785787813.411495:0:15809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785787813.411498:0:15809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf7f15fa/0xe2c2ff68a6e857b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.411505:0:15809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677cc00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785787813.411508:0:15809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf7f15fa/0xe2c2ff68a6e857b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.411528:0:15809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf7f15fa/0xe2c2ff68a6e857b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.411539:0:15809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf7f15fa/0xe2c2ff68a6e857b7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.411545:0:15809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf7f15fa/0xe2c2ff68a6e857b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.411568:0:15809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787813.411570:0:15809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787813.411572:0:15809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1785787813.411956:0:14938:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785787813.411961:0:14938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fda141e/0xe2c2ff68a6e857be lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.411969:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=600s v=(0 0) 00010000:00010000:2.0:1785787813.411972:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785787813.411976:0:14938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fda141e/0xe2c2ff68a6e857be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.411985:0:14938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000fda141e/0xe2c2ff68a6e857be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.412004:0:14938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fda141e/0xe2c2ff68a6e857be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.412017:0:14938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000fda141e/0xe2c2ff68a6e857be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.412030:0:14938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785787813.412038:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785787813.412042:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000fda141e/0xe2c2ff68a6e857be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.412048:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677c400 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785787813.412051:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000fda141e/0xe2c2ff68a6e857be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.412058:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000fda141e/0xe2c2ff68a6e857be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.412068:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000fda141e/0xe2c2ff68a6e857be lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.412074:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000fda141e/0xe2c2ff68a6e857be lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.412085:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787813.412086:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787813.412087:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1785787813.414189:0:14938:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785787813.414204:0:14938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085660750/0xe2c2ff68a6e857c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.414215:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=600s v=(0 0) 00010000:00010000:2.0:1785787813.414218:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785787813.414222:0:14938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085660750/0xe2c2ff68a6e857c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.414232:0:14938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085660750/0xe2c2ff68a6e857c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.414240:0:14938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085660750/0xe2c2ff68a6e857c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.414247:0:14938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085660750/0xe2c2ff68a6e857c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.414262:0:14938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785787813.414272:0:15809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785787813.414277:0:15809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085660750/0xe2c2ff68a6e857c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.414284:0:15809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413a0e00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785787813.415058:0:15809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085660750/0xe2c2ff68a6e857c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.415071:0:15809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085660750/0xe2c2ff68a6e857c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.415089:0:15809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085660750/0xe2c2ff68a6e857c5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.415097:0:15809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085660750/0xe2c2ff68a6e857c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.415113:0:15809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787813.415115:0:15809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787813.415117:0:15809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787813.415588:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1785787813.417730:0:14938:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785787813.417739:0:14938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc57ae70/0xe2c2ff68a6e857cc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.417752:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=600s v=(0 0) 00010000:00010000:2.0:1785787813.417756:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785787813.417761:0:14938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc57ae70/0xe2c2ff68a6e857cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.417773:0:14938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc57ae70/0xe2c2ff68a6e857cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.417781:0:14938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc57ae70/0xe2c2ff68a6e857cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.417789:0:14938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc57ae70/0xe2c2ff68a6e857cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.417815:0:14938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785787813.417825:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785787813.417845:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc57ae70/0xe2c2ff68a6e857cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.417852:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413a0600 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785787813.417856:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc57ae70/0xe2c2ff68a6e857cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.417865:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc57ae70/0xe2c2ff68a6e857cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.417879:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc57ae70/0xe2c2ff68a6e857cc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.417885:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc57ae70/0xe2c2ff68a6e857cc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.417899:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787813.417900:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787813.417902:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1785787813.421781:0:14938:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785787813.421793:0:14938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf3ad2a4/0xe2c2ff68a6e857d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.421808:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=600s v=(0 0) 00010000:00010000:2.0:1785787813.421819:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785787813.421825:0:14938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf3ad2a4/0xe2c2ff68a6e857d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.428161:0:14938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf3ad2a4/0xe2c2ff68a6e857d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.428177:0:14938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf3ad2a4/0xe2c2ff68a6e857d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.428186:0:14938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf3ad2a4/0xe2c2ff68a6e857d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.428203:0:14938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00100000:1.0:1785787813.428374:0:7522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1785787813.428581:0:15809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785787813.428588:0:15809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf3ad2a4/0xe2c2ff68a6e857d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787813.428597:0:15809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413a1e00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:0.0:1785787813.428602:0:15809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf3ad2a4/0xe2c2ff68a6e857d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787813.428611:0:15809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf3ad2a4/0xe2c2ff68a6e857d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787813.428631:0:15809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf3ad2a4/0xe2c2ff68a6e857d3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787813.428638:0:15809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf3ad2a4/0xe2c2ff68a6e857d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787813.428671:0:15809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787813.428673:0:15809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787813.428675:0:15809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1785787813.430939:0:14938:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785787813.430948:0:14938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9fa2ac1/0xe2c2ff68a6e857da lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.430960:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=600s v=(0 0) 00010000:00010000:2.0:1785787813.430964:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785787813.430969:0:14938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9fa2ac1/0xe2c2ff68a6e857da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.430981:0:14938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9fa2ac1/0xe2c2ff68a6e857da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.432128:0:14938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9fa2ac1/0xe2c2ff68a6e857da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.432146:0:14938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9fa2ac1/0xe2c2ff68a6e857da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.432162:0:14938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1785787813.432819:0:14938:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785787813.432825:0:14938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc57ae70/0xe2c2ff68a6e857e1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.432848:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=600s v=(0 0) 00010000:00010000:2.0:1785787813.432852:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785787813.432856:0:14938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc57ae70/0xe2c2ff68a6e857e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.432867:0:14938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc57ae70/0xe2c2ff68a6e857e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.432876:0:14938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc57ae70/0xe2c2ff68a6e857e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.432884:0:14938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc57ae70/0xe2c2ff68a6e857e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.432898:0:14938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1785787813.432909:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1785787813.432914:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9fa2ac1/0xe2c2ff68a6e857da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.432928:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413a0400 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785787813.432932:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9fa2ac1/0xe2c2ff68a6e857da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.432940:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9fa2ac1/0xe2c2ff68a6e857da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.432954:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9fa2ac1/0xe2c2ff68a6e857da lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.432961:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9fa2ac1/0xe2c2ff68a6e857da lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.432974:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785787813.432977:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc57ae70/0xe2c2ff68a6e857e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.432983:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413a0600 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785787813.433986:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787813.436951:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc57ae70/0xe2c2ff68a6e857e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.436973:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc57ae70/0xe2c2ff68a6e857e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.437032:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc57ae70/0xe2c2ff68a6e857e1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.437051:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc57ae70/0xe2c2ff68a6e857e1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.437073:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787813.437075:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787813.437076:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1785787813.437816:0:14938:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785787813.437824:0:14938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085660750/0xe2c2ff68a6e857e8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.437848:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=600s v=(0 0) 00010000:00010000:2.0:1785787813.437852:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785787813.437857:0:14938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085660750/0xe2c2ff68a6e857e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.437868:0:14938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085660750/0xe2c2ff68a6e857e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.437876:0:14938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085660750/0xe2c2ff68a6e857e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.437882:0:14938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085660750/0xe2c2ff68a6e857e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.437902:0:14938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785787813.441584:0:15809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785787813.441595:0:15809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085660750/0xe2c2ff68a6e857e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787813.441607:0:15809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413a0e00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785787813.441612:0:15809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085660750/0xe2c2ff68a6e857e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787813.441623:0:15809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085660750/0xe2c2ff68a6e857e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787813.441640:0:15809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085660750/0xe2c2ff68a6e857e8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787813.441660:0:15809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085660750/0xe2c2ff68a6e857e8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787813.441684:0:15809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787813.441686:0:15809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787813.441687:0:15809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1785787813.443088:0:14938:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785787813.443100:0:14938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba981a62/0xe2c2ff68a6e857ef lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.443111:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=600s v=(0 0) 00010000:00010000:2.0:1785787813.443116:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785787813.443121:0:14938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba981a62/0xe2c2ff68a6e857ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.443131:0:14938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba981a62/0xe2c2ff68a6e857ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.443140:0:14938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba981a62/0xe2c2ff68a6e857ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.443148:0:14938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba981a62/0xe2c2ff68a6e857ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.443168:0:14938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785787813.443196:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785787813.443201:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba981a62/0xe2c2ff68a6e857ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787813.443209:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413a0a00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:1.0:1785787813.443212:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba981a62/0xe2c2ff68a6e857ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787813.443220:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba981a62/0xe2c2ff68a6e857ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787813.443231:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba981a62/0xe2c2ff68a6e857ef lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787813.443238:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba981a62/0xe2c2ff68a6e857ef lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787813.443250:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787813.443252:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787813.443253:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1785787813.446665:0:14938:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785787813.446676:0:14938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d628fdd/0xe2c2ff68a6e857f6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.446690:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=600s v=(0 0) 00010000:00010000:2.0:1785787813.446694:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785787813.446700:0:14938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d628fdd/0xe2c2ff68a6e857f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.446713:0:14938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d628fdd/0xe2c2ff68a6e857f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.446728:0:14938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d628fdd/0xe2c2ff68a6e857f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.446736:0:14938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d628fdd/0xe2c2ff68a6e857f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.446763:0:14938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1785787813.450732:0:14938:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785787813.450743:0:14938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005357c164/0xe2c2ff68a6e857fd lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.450758:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=600s v=(0 0) 00010000:00010000:2.0:1785787813.450763:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785787813.450768:0:14938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005357c164/0xe2c2ff68a6e857fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.450780:0:14938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005357c164/0xe2c2ff68a6e857fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.450790:0:14938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005357c164/0xe2c2ff68a6e857fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.450797:0:14938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005357c164/0xe2c2ff68a6e857fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.450825:0:14938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1785787813.450851:0:15809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1785787813.450857:0:15809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d628fdd/0xe2c2ff68a6e857f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.450865:0:15809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413a1400 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785787813.450871:0:15809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d628fdd/0xe2c2ff68a6e857f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.450881:0:15809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d628fdd/0xe2c2ff68a6e857f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.450897:0:15809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d628fdd/0xe2c2ff68a6e857f6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.450905:0:15809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d628fdd/0xe2c2ff68a6e857f6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.450922:0:15809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785787813.450925:0:15809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005357c164/0xe2c2ff68a6e857fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.450932:0:15809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413a1200 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785787813.450935:0:15809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005357c164/0xe2c2ff68a6e857fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.450953:0:15809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005357c164/0xe2c2ff68a6e857fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.450963:0:15809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005357c164/0xe2c2ff68a6e857fd lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.450970:0:15809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005357c164/0xe2c2ff68a6e857fd lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.450982:0:15809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787813.450984:0:15809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787813.450986:0:15809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787813.452517:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1785787813.456636:0:14938:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785787813.456650:0:14938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054f53666/0xe2c2ff68a6e85804 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787813.456667:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=600s v=(0 0) 00010000:00010000:3.0:1785787813.456670:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785787813.456678:0:14938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054f53666/0xe2c2ff68a6e85804 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787813.456693:0:14938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054f53666/0xe2c2ff68a6e85804 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787813.456703:0:14938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054f53666/0xe2c2ff68a6e85804 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787813.456711:0:14938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054f53666/0xe2c2ff68a6e85804 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787813.456738:0:14938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1785787813.457229:0:14938:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785787813.457235:0:14938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aeaab4da/0xe2c2ff68a6e8580b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787813.457243:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=600s v=(0 0) 00010000:00010000:3.0:1785787813.457246:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785787813.457250:0:14938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aeaab4da/0xe2c2ff68a6e8580b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787813.457258:0:14938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aeaab4da/0xe2c2ff68a6e8580b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787813.457265:0:14938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aeaab4da/0xe2c2ff68a6e8580b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787813.457271:0:14938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aeaab4da/0xe2c2ff68a6e8580b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787813.457285:0:14938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1785787813.457482:0:15809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1785787813.457491:0:15809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054f53666/0xe2c2ff68a6e85804 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.457499:0:15809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903a00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785787813.457504:0:15809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054f53666/0xe2c2ff68a6e85804 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785787813.457896:0:14938:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785787813.457902:0:14938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063ab44da/0xe2c2ff68a6e85812 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787813.457911:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=600s v=(0 0) 00010000:00010000:3.0:1785787813.457915:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785787813.457919:0:14938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063ab44da/0xe2c2ff68a6e85812 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787813.457938:0:14938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063ab44da/0xe2c2ff68a6e85812 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787813.457946:0:14938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063ab44da/0xe2c2ff68a6e85812 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787813.457953:0:14938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000063ab44da/0xe2c2ff68a6e85812 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787813.457966:0:14938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1785787813.457975:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1785787813.457979:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aeaab4da/0xe2c2ff68a6e8580b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787813.457985:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f902c00 already unused, calling callback (ffffffffc174c300) 00010000:00010000:3.0:1785787813.457988:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aeaab4da/0xe2c2ff68a6e8580b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787813.457996:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aeaab4da/0xe2c2ff68a6e8580b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787813.458010:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aeaab4da/0xe2c2ff68a6e8580b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787813.458017:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aeaab4da/0xe2c2ff68a6e8580b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787813.458039:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785787813.458043:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000063ab44da/0xe2c2ff68a6e85812 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787813.458049:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f902400 already unused, calling callback (ffffffffc174c300) 00010000:00010000:3.0:1785787813.458052:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000063ab44da/0xe2c2ff68a6e85812 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787813.458061:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000063ab44da/0xe2c2ff68a6e85812 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.458061:0:15809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054f53666/0xe2c2ff68a6e85804 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787813.458072:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000063ab44da/0xe2c2ff68a6e85812 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.458073:0:15809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054f53666/0xe2c2ff68a6e85804 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787813.458080:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063ab44da/0xe2c2ff68a6e85812 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787813.458091:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787813.458092:0:15809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054f53666/0xe2c2ff68a6e85804 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787813.458093:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787813.458095:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787813.458105:0:15809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787813.458107:0:15809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787813.458109:0:15809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787813.458657:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1785787813.459160:0:14938:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785787813.459166:0:14938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cdea084/0xe2c2ff68a6e85819 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787813.459176:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=600s v=(0 0) 00010000:00010000:3.0:1785787813.459179:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785787813.459189:0:14938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cdea084/0xe2c2ff68a6e85819 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787813.459198:0:14938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cdea084/0xe2c2ff68a6e85819 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787813.459206:0:14938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cdea084/0xe2c2ff68a6e85819 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787813.459213:0:14938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cdea084/0xe2c2ff68a6e85819 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787813.459229:0:14938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1785787813.459398:0:14938:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:3.0:1785787813.459963:0:14938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:14326:x1872533770058240:12345-0@lo:5:osp-pre-1-0.0 Request processed in 159082us (159471us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787813.459973:0:14938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1785787813.460063:0:14326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bd9a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14326:1872533770058240:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1785787813.460076:0:14326:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:0.0:1785787813.460115:0:14326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41393800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14326:1872533770058496:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1785787813.460146:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787813.460191:0:14326:0:(client.c:2702:ptlrpc_set_wait()) set ffff919077106600 going to sleep for 11 seconds 00000100:00100000:3.0:1785787813.460952:0:14939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770058496 00000100:00100000:3.0:1785787813.460958:0:14939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770058496 00000100:00100000:3.0:1785787813.461010:0:14939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1785787813.461018:0:14939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41392a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:14326:x1872533770058496:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1785787813.461051:0:14939:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:2.0:1785787813.462432:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785787813.462440:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cdea084/0xe2c2ff68a6e85819 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.462452:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f902000 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785787813.462456:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cdea084/0xe2c2ff68a6e85819 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.462466:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cdea084/0xe2c2ff68a6e85819 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.462484:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cdea084/0xe2c2ff68a6e85819 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.462490:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cdea084/0xe2c2ff68a6e85819 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787813.462507:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787813.462509:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787813.462510:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787813.469159:0:14939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41392a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14326:x1872533770058496:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8134us (9005us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1785787813.469171:0:14939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1785787813.469647:0:14326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41393800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14326:1872533770058496:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1785787813.469662:0:14326:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:1.0:1785787813.899915:0:15809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1785787814.466212:0:14333:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1785787814.899796:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787815.926875:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787816.947062:0:15809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1785787817.124643:0:15966:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg353-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1785787817.973658:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787818.434672:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41390a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770058624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785787818.434734:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787818.434811:0:14941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770058624 00000100:00100000:0.0:1785787818.434818:0:14941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770058624 00000100:00100000:0.0:1785787818.434880:0:14941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1785787818.434889:0:14941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41391880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3334:x1872533770058624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785787818.434918:0:14941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785787818.434959:0:14941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41391880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3334:x1872533770058624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787818.434966:0:14941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1785787818.435135:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785787818.435170:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41390a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770058624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785787818.437911:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076d8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770058752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785787818.437964:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787818.438097:0:14941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770058752 00000100:00100000:0.0:1785787818.438104:0:14941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770058752 00000100:00100000:0.0:1785787818.438151:0:14941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1785787818.438157:0:14940:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1785787818.438161:0:14941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41390a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533770058752:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785787818.438168:0:14940:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:0.0:1785787818.438190:0:14941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785787818.438238:0:14941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41390a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533770058752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787818.438245:0:14941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1785787818.438264:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785787818.439717:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bd99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9a1da20-2955-44fa-b075-f73628199db8:3336:1872533770058880:0@lo:400:kworker.0 00000100:00100000:0.0:1785787818.439760:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787818.439861:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785787818.439872:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bd9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3336:1872533770059264:0@lo:400:kworker.0 00000100:00100000:0.0:1785787818.439903:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787818.439936:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bd99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1872533770059008:0@lo:400:kworker.0 00000100:00100000:0.0:1785787818.439972:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787818.440078:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785787818.440087:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bd99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3333:1872533770059136:0@lo:400:kworker.0 00000100:00100000:0.0:1785787818.440116:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787818.443234:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076d8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770058752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785787818.443300:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770058880 00000100:00100000:3.0:1785787818.443307:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770058880 00000100:00100000:3.0:1785787818.443348:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1785787818.443356:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076f1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+19:3336:x1872533770058880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787818.443420:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076f1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+19:3336:x1872533770058880:12345-0@lo:400:kworker.0 Request processed in 65us (3660us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787818.443440:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1785787818.443495:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bd99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9a1da20-2955-44fa-b075-f73628199db8:3336:1872533770058880:0@lo:400:kworker.0 00000100:00100000:3.0:1785787818.445872:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770059264 00000100:00100000:3.0:1785787818.445881:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770059264 00000100:00100000:3.0:1785787818.445927:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770059008 00000100:00100000:3.0:1785787818.445931:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770059008 00000100:00100000:3.0:1785787818.445947:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770059136 00000100:00100000:3.0:1785787818.445949:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770059136 00000100:00100000:3.0:1785787818.445964:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1785787818.445971:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41393100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3336:x1872533770059264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787818.446030:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41393100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3336:x1872533770059264:12345-0@lo:400:kworker.0 Request processed in 60us (6127us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787818.446038:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1785787818.446056:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1785787818.446063:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41392300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1872533770059008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787818.446101:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41392300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1872533770059008:12345-0@lo:400:kworker.0 Request processed in 40us (6129us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787818.446108:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1785787818.446121:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1785787818.446129:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41392680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1872533770059136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787818.446174:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41392680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1872533770059136:12345-0@lo:400:kworker.0 Request processed in 47us (6059us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787818.446182:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1785787818.446224:0:3336:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907bd9a680 x1872533770059264/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785787818.446238:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bd9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3336:1872533770059264:0@lo:400:kworker.0 00000100:00080000:0.0:1785787818.448768:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1785787818.449182:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907bd99180 x1872533770059136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787818.449197:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bd99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3333:1872533770059136:0@lo:400:kworker.0 00010000:00080000:0.0:1785787818.449222:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91907bd99880 x1872533770059008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785787834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785787818.449231:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bd99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1872533770059008:0@lo:400:kworker.0 00000001:00080000:1.0:1785787818.566608:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:1.0:1785787818.998906:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787820.019033:0:15809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785787820.200914:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787820.201012:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744889088 00000100:00100000:0.0:1785787820.201022:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744889088 00000100:00100000:0.0:1785787820.201066:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 76 00000100:00100000:0.0:1785787820.201075:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076f19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2387:x1872533744889088:12345-192.168.203.53@tcp:250:mount.lustre.0 00010000:00080000:0.0:1785787820.201100:0:14296:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 6d0cc6bb-46e4-48f9-b637-88656ab6ce94@192.168.203.53@tcp t0 exp 0000000000000000 cur 607 last 0 00000020:00000080:0.0:1785787820.201123:0:14296:0:(genops.c:1406:class_connect()) connect: client 6d0cc6bb-46e4-48f9-b637-88656ab6ce94, cookie 0xe2c2ff68a6e85820 00000100:00080000:0.0:1785787820.201235:0:14296:0:(import.c:65:import_set_state_nolock()) ffff918f4120a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1785787820.201299:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076f19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+5:2387:x1872533744889088:12345-192.168.203.53@tcp:250:mount.lustre.0 Request processed in 224us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787820.201306:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 76 00000100:00100000:1.0:1785787820.221656:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787820.221737:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744889216 00000100:00100000:3.0:1785787820.221747:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744889216 00000100:00100000:3.0:1785787820.221797:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 77 00000100:00100000:3.0:1785787820.221805:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076f19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+5:13765:x1872533744889216:12345-192.168.203.53@tcp:101:mount.lustre.0 00010000:00010000:3.0:1785787820.221820:0:14294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787820.221866:0:14294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91905f902400/0xe2c2ff68a6e85827 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd6d5 expref: -99 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787820.221892:0:14294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91905f902400/0xe2c2ff68a6e85827 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd6d5 expref: 6 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787820.221902:0:14294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91905f902400/0xe2c2ff68a6e85827 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd6d5 expref: 6 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787820.221912:0:14294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f902400, rc 0) 00000100:00100000:3.0:1785787820.221967:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076f19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+6:13765:x1872533744889216:12345-192.168.203.53@tcp:101:mount.lustre.0 Request processed in 162us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787820.221974:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 77 00000100:00100000:2.0:1785787820.225162:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787820.231700:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744889344 00000100:00100000:3.0:1785787820.231713:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744889344 00000100:00100000:3.0:1785787820.231865:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 78 00000100:00100000:3.0:1785787820.231875:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076f1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+6:13765:x1872533744889344:12345-192.168.203.53@tcp:501:mount.lustre.0 00000100:00100000:3.0:1785787820.232130:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076f1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+6:13765:x1872533744889344:12345-192.168.203.53@tcp:501:mount.lustre.0 Request processed in 255us (6972us total) trans 0 rc -2/-2 00000100:00100000:3.0:1785787820.232138:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 78 00000100:00100000:2.0:1785787820.250699:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787820.250864:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744889472 00000100:00100000:0.0:1785787820.250872:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744889472 00000100:00100000:0.0:1785787820.250924:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 79 00000100:00100000:0.0:1785787820.250933:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076f1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+6:13765:x1872533744889472:12345-192.168.203.53@tcp:101:mount.lustre.0 00010000:00010000:0.0:1785787820.250950:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787820.250967:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919052f5e600/0xe2c2ff68a6e8582e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd6dc expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787820.250995:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919052f5e600/0xe2c2ff68a6e8582e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd6dc expref: 7 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787820.251007:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919052f5e600/0xe2c2ff68a6e8582e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd6dc expref: 7 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787820.251033:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919052f5e600, rc 0) 00000100:00100000:0.0:1785787820.251086:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076f1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+7:13765:x1872533744889472:12345-192.168.203.53@tcp:101:mount.lustre.0 Request processed in 154us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787820.251093:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 79 00000100:00100000:1.0:1785787820.259931:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787820.266685:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744889600 00000100:00100000:3.0:1785787820.266699:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744889600 00000100:00100000:2.0:1785787820.271454:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 80 00000100:00100000:2.0:1785787820.271465:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076f1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+7:13765:x1872533744889600:12345-192.168.203.53@tcp:501:mount.lustre.0 00000100:00100000:2.0:1785787820.271903:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076f1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+8:13765:x1872533744889600:12345-192.168.203.53@tcp:501:mount.lustre.0 Request processed in 438us (11980us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787820.271911:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 80 00000100:00100000:3.0:1785787820.276891:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787820.277072:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744889728 00000100:00100000:2.0:1785787820.277081:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744889728 00000100:00100000:2.0:1785787820.277126:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 81 00000100:00100000:2.0:1785787820.277134:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+8:13765:x1872533744889728:12345-192.168.203.53@tcp:503:mount.lustre.0 00000100:00100000:2.0:1785787820.277314:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+8:13765:x1872533744889728:12345-192.168.203.53@tcp:503:mount.lustre.0 Request processed in 179us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787820.277321:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 81 00000100:00100000:3.0:1785787820.280153:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787820.280310:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744889856 00000100:00100000:0.0:1785787820.280318:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744889856 00000100:00100000:0.0:1785787820.280359:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 82 00000100:00100000:0.0:1785787820.280376:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+8:13784:x1872533744889856:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1785787820.280586:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+8:13784:x1872533744889856:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 210us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787820.280594:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 82 00000100:00100000:1.0:1785787820.325118:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787820.325196:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744889984 00000100:00100000:3.0:1785787820.325206:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744889984 00000100:00100000:3.0:1785787820.325257:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 83 00000100:00100000:3.0:1785787820.325267:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+8:13784:x1872533744889984:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1785787820.325628:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+8:13784:x1872533744889984:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 361us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787820.325636:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 83 00000100:00100000:3.0:1785787820.343111:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787820.343358:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744890112 00000100:00100000:2.0:1785787820.343375:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744890112 00000100:00100000:2.0:1785787820.343420:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 84 00000100:00100000:2.0:1785787820.343429:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+8:13765:x1872533744890112:12345-192.168.203.53@tcp:101:mount.lustre.0 00010000:00010000:2.0:1785787820.343444:0:14294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787820.343460:0:14294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190413a1e00/0xe2c2ff68a6e85835 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd706 expref: -99 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787820.343496:0:14294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190413a1e00/0xe2c2ff68a6e85835 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd706 expref: 9 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787820.343530:0:14294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190413a1e00/0xe2c2ff68a6e85835 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd706 expref: 9 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787820.343539:0:14294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190413a1e00, rc 0) 00000100:00100000:2.0:1785787820.343593:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+9:13765:x1872533744890112:12345-192.168.203.53@tcp:101:mount.lustre.0 Request processed in 164us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787820.343600:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 84 00000100:00100000:2.0:1785787820.348900:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787820.348963:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744890240 00000100:00100000:0.0:1785787820.348972:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744890240 00000100:00100000:0.0:1785787820.349023:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 85 00000100:00100000:0.0:1785787820.349033:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+9:13765:x1872533744890240:12345-192.168.203.53@tcp:256:mount.lustre.0 20000000:01000000:0.0:1785787820.349057:0:14296:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1785787820.349080:0:14296:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1785787820.349085:0:14296:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1785787820.349088:0:14296:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1785787820.349090:0:14296:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1785787820.350647:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+9:13765:x1872533744890240:12345-192.168.203.53@tcp:256:mount.lustre.0 Request processed in 1612us (1751us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787820.350656:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 85 00000100:00100000:3.0:1785787820.364378:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787820.364530:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744890368 00000100:00100000:2.0:1785787820.364540:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744890368 00000100:00100000:2.0:1785787820.364589:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 86 00000100:00100000:2.0:1785787820.364600:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+9:13765:x1872533744890368:12345-192.168.203.53@tcp:101:mount.lustre.0 00010000:00010000:2.0:1785787820.364623:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787820.364640:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190413a0a00/0xe2c2ff68a6e8583c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd70d expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787820.364669:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190413a0a00/0xe2c2ff68a6e8583c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd70d expref: 10 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787820.364681:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190413a0a00/0xe2c2ff68a6e8583c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd70d expref: 10 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787820.364690:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190413a0a00, rc 0) 00000100:00100000:2.0:1785787820.364747:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+10:13765:x1872533744890368:12345-192.168.203.53@tcp:101:mount.lustre.0 Request processed in 149us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787820.364754:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 86 00000100:00100000:2.0:1785787820.372145:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787820.372234:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744890496 00000100:00100000:0.0:1785787820.372243:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744890496 00000100:00100000:0.0:1785787820.372301:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 87 00000100:00100000:0.0:1785787820.372310:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+10:13765:x1872533744890496:12345-192.168.203.53@tcp:501:mount.lustre.0 00000100:00100000:0.0:1785787820.372590:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+10:13765:x1872533744890496:12345-192.168.203.53@tcp:501:mount.lustre.0 Request processed in 280us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787820.372598:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 87 00000100:00100000:1.0:1785787820.379006:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787820.379084:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744890624 00000100:00100000:3.0:1785787820.379092:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744890624 00000100:00100000:3.0:1785787820.379142:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 88 00000100:00100000:3.0:1785787820.379151:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+10:13765:x1872533744890624:12345-192.168.203.53@tcp:503:mount.lustre.0 00000100:00100000:3.0:1785787820.379338:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+10:13765:x1872533744890624:12345-192.168.203.53@tcp:503:mount.lustre.0 Request processed in 187us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787820.379346:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 88 00000100:00100000:3.0:1785787820.380989:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787820.383190:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744890752 00000100:00100000:2.0:1785787820.383201:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744890752 00000100:00100000:2.0:1785787820.383264:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 89 00000100:00100000:2.0:1785787820.383274:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+10:13788:x1872533744890752:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1785787820.383520:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+10:13788:x1872533744890752:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 247us (2533us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787820.383528:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 89 00000100:00100000:2.0:1785787820.388914:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787820.389025:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744890880 00000100:00100000:0.0:1785787820.389034:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744890880 00000100:00100000:0.0:1785787820.389083:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 90 00000100:00100000:0.0:1785787820.389100:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+10:13788:x1872533744890880:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1785787820.389545:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+10:13788:x1872533744890880:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 452us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787820.389553:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 90 00000100:00100000:1.0:1785787820.421609:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787820.421735:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744891008 00000100:00100000:3.0:1785787820.421745:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744891008 00000100:00100000:3.0:1785787820.421790:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 4 00000100:00100000:3.0:1785787820.421798:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2387:x1872533744891008:12345-192.168.203.53@tcp:38:mount.lustre.0 00010000:00080000:3.0:1785787820.421863:0:14301:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from aabe278a-8cfd-4235-9dd3-056b28921491@192.168.203.53@tcp t0 exp 0000000000000000 cur 607 last 0 00000020:00000080:3.0:1785787820.421911:0:14301:0:(genops.c:1406:class_connect()) connect: client aabe278a-8cfd-4235-9dd3-056b28921491, cookie 0xe2c2ff68a6e85843 00000004:00100000:3.0:1785787820.421937:0:14301:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1785787820.421942:0:14301:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1785787820.484956:0:14301:0:(import.c:65:import_set_state_nolock()) ffff918f43331000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1785787820.485077:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aabe278a-8cfd-4235-9dd3-056b28921491+6:2387:x1872533744891008:12345-192.168.203.53@tcp:38:mount.lustre.0 Request processed in 63277us (63476us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787820.485088:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 4 00000100:00100000:3.0:1785787820.493443:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787820.493490:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787820.495924:0:15621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744891264 00000100:00100000:1.0:1785787820.495934:0:15621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744891264 00000100:00100000:1.0:1785787820.495996:0:15621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744891136 00000100:00100000:1.0:1785787820.495999:0:15621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744891136 00000100:00100000:1.0:1785787820.496022:0:15621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 5 00000100:00100000:1.0:1785787820.496031:0:15621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076d8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aabe278a-8cfd-4235-9dd3-056b28921491+7:13765:x1872533744891264:12345-192.168.203.53@tcp:41:mount.lustre.0 00000004:00000024:1.0:1785787820.496072:0:15621:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1785787820.496187:0:15621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076d8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aabe278a-8cfd-4235-9dd3-056b28921491+7:13765:x1872533744891264:12345-192.168.203.53@tcp:41:mount.lustre.0 Request processed in 156us (3619us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787820.496194:0:15621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 5 00000100:00100000:1.0:1785787820.496209:0:15621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 6 00000100:00100000:1.0:1785787820.496214:0:15621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076d8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aabe278a-8cfd-4235-9dd3-056b28921491+6:0:x1872533744891136:12345-192.168.203.53@tcp:41:mount.lustre.0 00000004:00000024:1.0:1785787820.497357:0:15621:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1785787820.497435:0:15621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076d8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aabe278a-8cfd-4235-9dd3-056b28921491+6:0:x1872533744891136:12345-192.168.203.53@tcp:41:mount.lustre.0 Request processed in 1218us (3944us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787820.497443:0:15621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 6 00000100:00080000:0.0:1785787820.498891:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785787820.505575:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787820.508917:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744891392 00000100:00100000:3.0:1785787820.508930:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744891392 00000100:00100000:3.0:1785787820.509039:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 7 00000100:00100000:3.0:1785787820.509050:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aabe278a-8cfd-4235-9dd3-056b28921491+6:13765:x1872533744891392:12345-192.168.203.53@tcp:40:mount.lustre.0 00000100:00100000:3.0:1785787820.509143:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aabe278a-8cfd-4235-9dd3-056b28921491+6:13765:x1872533744891392:12345-192.168.203.53@tcp:40:mount.lustre.0 Request processed in 95us (3576us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787820.509150:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 7 00000100:00100000:1.0:1785787820.516690:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787820.516724:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787820.516824:0:14937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744891520 00000100:00100000:2.0:1785787820.516858:0:14937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744891520 00000100:00100000:2.0:1785787820.516887:0:14937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744891648 00000100:00100000:2.0:1785787820.516890:0:14937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744891648 00000100:00100000:2.0:1785787820.516902:0:14937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 9 00000100:00100000:2.0:1785787820.516909:0:14937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2387:x1872533744891520:12345-192.168.203.53@tcp:8:mount.lustre.0 00010000:00080000:2.0:1785787820.516937:0:14937:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from aabe278a-8cfd-4235-9dd3-056b28921491@192.168.203.53@tcp t0 exp 0000000000000000 cur 607 last 0 00000020:00000080:2.0:1785787820.516962:0:14937:0:(genops.c:1406:class_connect()) connect: client aabe278a-8cfd-4235-9dd3-056b28921491, cookie 0xe2c2ff68a6e8584a 00002000:00100000:2.0:1785787820.516972:0:14937:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli aabe278a-8cfd-4235-9dd3-056b28921491/ffff919077aaf800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113801 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1785787820.516991:0:14937:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1785787820.517478:0:14937:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1785787820.517514:0:14937:0:(import.c:65:import_set_state_nolock()) ffff919077aa8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1785787820.517590:0:14937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aabe278a-8cfd-4235-9dd3-056b28921491+6:2387:x1872533744891520:12345-192.168.203.53@tcp:8:mount.lustre.0 Request processed in 680us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787820.517602:0:14937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 9 00000100:00100000:2.0:1785787820.517620:0:14937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 10 00000100:00100000:2.0:1785787820.517637:0:14937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2387:x1872533744891648:12345-192.168.203.53@tcp:8:mount.lustre.0 00010000:00080000:2.0:1785787820.517652:0:14937:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from aabe278a-8cfd-4235-9dd3-056b28921491@192.168.203.53@tcp t0 exp 0000000000000000 cur 607 last 0 00000020:00000080:2.0:1785787820.517667:0:14937:0:(genops.c:1406:class_connect()) connect: client aabe278a-8cfd-4235-9dd3-056b28921491, cookie 0xe2c2ff68a6e85851 00002000:00100000:2.0:1785787820.517672:0:14937:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli aabe278a-8cfd-4235-9dd3-056b28921491/ffff919077aa9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113801 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1785787820.518071:0:14937:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1785787820.518519:0:14937:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1785787820.518537:0:14937:0:(import.c:65:import_set_state_nolock()) ffff919077aad000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1785787820.518614:0:14937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aabe278a-8cfd-4235-9dd3-056b28921491+6:2387:x1872533744891648:12345-192.168.203.53@tcp:8:mount.lustre.0 Request processed in 975us (1888us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787820.518621:0:14937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 10 00000100:00100000:1.0:1785787820.525544:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787820.527397:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744891776 00000100:00100000:2.0:1785787820.527407:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744891776 00000100:00100000:2.0:1785787820.527459:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 0 00000100:00100000:2.0:1785787820.527468:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aabe278a-8cfd-4235-9dd3-056b28921491+6:13765:x1872533744891776:12345-192.168.203.53@tcp:33:mount.lustre.0 00000004:00080000:2.0:1785787820.528163:0:14304:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 605us 00000004:00200000:0.0:1785787820.560867:0:14304:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1785787820.561031:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aabe278a-8cfd-4235-9dd3-056b28921491+6:13765:x1872533744891776:12345-192.168.203.53@tcp:33:mount.lustre.0 Request processed in 33558us (35490us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787820.561044:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 0 00000100:00100000:1.0:1785787820.830923:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787820.831081:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744891904 00000100:00100000:2.0:1785787820.831091:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744891904 00000100:00100000:2.0:1785787820.831152:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 8 00000100:00100000:2.0:1785787820.831162:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aabe278a-8cfd-4235-9dd3-056b28921491+6:13809:x1872533744891904:12345-192.168.203.53@tcp:101:mkdir.0 00010000:00010000:2.0:1785787820.831180:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787820.831249:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a0400/0xe2c2ff68a6e85858 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd737 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787820.831312:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1c00/0xe2c2ff68a6e8585f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787820.831343:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1c00/0xe2c2ff68a6e8585f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787820.831357:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1c00/0xe2c2ff68a6e8585f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787820.831559:0:14301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1785787820.831564:0:14301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1785787820.831658:0:14301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1c00/0xe2c2ff68a6e8585f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787820.831682:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a0400/0xe2c2ff68a6e85858 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd737 expref: 8 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787820.831699:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1c00/0xe2c2ff68a6e8585f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd737 expref: 7 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787820.831707:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919047f90100) 00010000:00010000:2.0:1785787820.831710:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785787820.831713:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190413a1c00, rc 0) 00000100:00100000:2.0:1785787820.831768:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aabe278a-8cfd-4235-9dd3-056b28921491+7:13809:x1872533744891904:12345-192.168.203.53@tcp:101:mkdir.0 Request processed in 607us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787820.831776:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 8 00010000:00010000:1.0:1785787821.044882:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787822.067257:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787823.091051:0:15809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785787823.288267:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787823.288768:0:15621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744892032 00000100:00100000:2.0:1785787823.288777:0:15621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744892032 00000100:00100000:2.0:1785787823.288870:0:15621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 9 00000100:00100000:2.0:1785787823.288880:0:15621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aabe278a-8cfd-4235-9dd3-056b28921491+7:13861:x1872533744892032:12345-192.168.203.53@tcp:41:lfs.0 00000004:00000024:2.0:1785787823.288918:0:15621:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1785787823.289013:0:15621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aabe278a-8cfd-4235-9dd3-056b28921491+7:13861:x1872533744892032:12345-192.168.203.53@tcp:41:lfs.0 Request processed in 135us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787823.289021:0:15621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 9 00000100:00080000:0.0:1785787823.290090:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785787823.310983:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787823.312532:0:14941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744892160 00000100:00100000:0.0:1785787823.312541:0:14941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744892160 00000100:00100000:0.0:1785787823.312614:0:14941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 7 00000100:00100000:0.0:1785787823.312623:0:14941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aabe278a-8cfd-4235-9dd3-056b28921491+6:13861:x1872533744892160:12345-192.168.203.53@tcp:13:lfs.0 00002000:00000024:0.0:1785787823.312658:0:14941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785787823.312744:0:14941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aabe278a-8cfd-4235-9dd3-056b28921491+6:13861:x1872533744892160:12345-192.168.203.53@tcp:13:lfs.0 Request processed in 122us (1769us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787823.312751:0:14941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 7 00000100:00080000:2.0:1785787823.313276:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785787823.314596:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787823.314661:0:16007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744892288 00000100:00100000:3.0:1785787823.314668:0:16007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744892288 00000100:00100000:3.0:1785787823.314716:0:16007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 8 00000100:00100000:3.0:1785787823.314724:0:16007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aabe278a-8cfd-4235-9dd3-056b28921491+6:13861:x1872533744892288:12345-192.168.203.53@tcp:13:lfs.0 00002000:00000024:3.0:1785787823.314748:0:16007:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785787823.314852:0:16007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aabe278a-8cfd-4235-9dd3-056b28921491+6:13861:x1872533744892288:12345-192.168.203.53@tcp:13:lfs.0 Request processed in 102us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787823.314870:0:16007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 8 00000100:00080000:2.0:1785787823.315016:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785787823.539261:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076d8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770059520:0@lo:400:kworker.0 00000100:00100000:3.0:1785787823.539328:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787823.539381:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076d89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3333:1872533770060032:0@lo:400:kworker.0 00000100:00100000:3.0:1785787823.539408:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787823.539429:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785787823.539434:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076d88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770059648:0@lo:400:kworker.0 00000100:00100000:3.0:1785787823.539455:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787823.539503:0:14939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770059520 00000100:00100000:3.0:1785787823.539510:0:14939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770059520 00000100:00100000:3.0:1785787823.539560:0:14939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770059648 00000100:00100000:3.0:1785787823.539564:0:14939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770059648 00000100:00100000:3.0:1785787823.539583:0:14939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1785787823.539590:0:14939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076d8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770059520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787823.539639:0:14939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076d8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770059520:12345-0@lo:400:kworker.0 Request processed in 49us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787823.539646:0:14939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1785787823.539660:0:14939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1785787823.539665:0:14939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076d89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770059648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787823.539686:0:14939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076d89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770059648:12345-0@lo:400:kworker.0 Request processed in 22us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787823.539691:0:14939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1785787823.539719:0:3333:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1785787823.539733:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076d88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770059648:0@lo:400:kworker.0 00000100:00100000:3.0:1785787823.539742:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076d8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770059520:0@lo:400:kworker.0 00000100:00100000:0.0:1785787823.541588:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076d8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9a1da20-2955-44fa-b075-f73628199db8:3336:1872533770059392:0@lo:400:kworker.0 00000100:00100000:0.0:1785787823.541632:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787823.541659:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076d8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3336:1872533770059904:0@lo:400:kworker.0 00000100:00100000:0.0:1785787823.541677:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787823.541694:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785787823.541700:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076d8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3336:1872533770059776:0@lo:400:kworker.0 00000100:00100000:0.0:1785787823.541715:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787823.541763:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770060032 00000100:00100000:0.0:1785787823.541767:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770060032 00000100:00100000:0.0:1785787823.541793:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770059904 00000100:00100000:0.0:1785787823.541795:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770059904 00000100:00100000:0.0:1785787823.541805:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770059776 00000100:00100000:0.0:1785787823.541807:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770059776 00000100:00100000:0.0:1785787823.541817:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1785787823.541823:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076d88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1872533770060032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787823.541874:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076d88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1872533770060032:12345-0@lo:400:kworker.0 Request processed in 50us (2465us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787823.541881:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1785787823.541892:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1785787823.541897:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41393800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3336:x1872533770059904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787823.541921:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41393800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3336:x1872533770059904:12345-0@lo:400:kworker.0 Request processed in 25us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787823.541926:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1785787823.541935:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1785787823.541940:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41390700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3336:x1872533770059776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787823.541958:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41390700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3336:x1872533770059776:12345-0@lo:400:kworker.0 Request processed in 18us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787823.541972:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1785787823.541997:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076d8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3336:1872533770059776:0@lo:400:kworker.0 00000100:00100000:0.0:1785787823.542005:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076d8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3336:1872533770059904:0@lo:400:kworker.0 00000100:00080000:2.0:1785787823.542125:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1785787823.542129:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785787823.542131:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785787823.542221:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770059392 00000100:00100000:3.0:1785787823.542225:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770059392 00000100:00100000:3.0:1785787823.542260:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1785787823.542267:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+19:3336:x1872533770059392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787823.542301:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+19:3336:x1872533770059392:12345-0@lo:400:kworker.0 Request processed in 35us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787823.542307:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1785787823.542334:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41390380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770060160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785787823.542358:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787823.542385:0:14940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770060160 00000100:00100000:3.0:1785787823.542389:0:14940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770060160 00000100:00100000:3.0:1785787823.542412:0:14940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1785787823.542418:0:14940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076d8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770060160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785787823.542432:0:14940:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785787823.542464:0:14940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076d8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770060160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787823.542469:0:14940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1785787823.542506:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41390380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770060160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785787823.542539:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076d89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3333:1872533770060032:0@lo:400:kworker.0 00000100:00100000:0.0:1785787823.542675:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076d8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9a1da20-2955-44fa-b075-f73628199db8:3336:1872533770059392:0@lo:400:kworker.0 00000100:00100000:0.0:1785787823.546545:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770060288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785787823.546593:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787823.546708:0:14941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770060288 00000100:00100000:1.0:1785787823.546716:0:14941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770060288 00000100:00100000:1.0:1785787823.546760:0:14941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1785787823.546769:0:14941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918f41393480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533770060288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785787823.546788:0:14941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785787823.546845:0:14941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918f41393480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533770060288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787823.546853:0:14941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1785787823.546935:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770060288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785787823.565613:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787823.565684:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744892416 00000100:00100000:2.0:1785787823.565693:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744892416 00000100:00100000:2.0:1785787823.565748:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 92 00000100:00100000:2.0:1785787823.565758:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+10:13893:x1872533744892416:12345-192.168.203.53@tcp:101:mount.lustre.0 00010000:00010000:2.0:1785787823.565775:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787823.565790:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190413a1000/0xe2c2ff68a6e85866 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd73e expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787823.565816:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190413a1000/0xe2c2ff68a6e85866 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd73e expref: 11 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787823.565853:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190413a1000/0xe2c2ff68a6e85866 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd73e expref: 11 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787823.565863:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190413a1000, rc 0) 00000100:00100000:2.0:1785787823.565924:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+11:13893:x1872533744892416:12345-192.168.203.53@tcp:101:mount.lustre.0 Request processed in 169us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787823.565931:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 92 00000100:00100000:1.0:1785787823.584262:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787823.584294:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744892544 00000100:00100000:1.0:1785787823.584303:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744892544 00000100:00100000:1.0:1785787823.584343:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 93 00000100:00100000:1.0:1785787823.584352:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+11:13893:x1872533744892544:12345-192.168.203.53@tcp:501:mount.lustre.0 00000100:00100000:1.0:1785787823.589757:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+11:13893:x1872533744892544:12345-192.168.203.53@tcp:501:mount.lustre.0 Request processed in 5151us (5248us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787823.589774:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 93 00000100:00100000:0.0:1785787823.601726:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787823.604565:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744892672 00000100:00100000:3.0:1785787823.604577:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744892672 00000100:00100000:3.0:1785787823.606489:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 94 00000100:00100000:3.0:1785787823.606502:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+11:13893:x1872533744892672:12345-192.168.203.53@tcp:503:mount.lustre.0 00000100:00100000:3.0:1785787823.606784:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+11:13893:x1872533744892672:12345-192.168.203.53@tcp:503:mount.lustre.0 Request processed in 285us (5068us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787823.606800:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 94 00000100:00100000:1.0:1785787823.624028:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787823.624108:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744892800 00000100:00100000:3.0:1785787823.624118:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744892800 00000100:00100000:0.0:1785787823.624229:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 95 00000100:00100000:0.0:1785787823.624241:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+11:13900:x1872533744892800:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1785787823.624561:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+11:13900:x1872533744892800:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 322us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787823.624570:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 95 00000001:00100000:1.0:1785787823.625397:0:7522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aabe278a-8cfd-4235-9dd3-056b28921491 00000100:00100000:2.0:1785787823.687642:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787823.687728:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744892928 00000100:00100000:3.0:1785787823.687737:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744892928 00000100:00100000:3.0:1785787823.687805:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 96 00000100:00100000:3.0:1785787823.687815:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+11:13900:x1872533744892928:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1785787823.688602:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+11:13900:x1872533744892928:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 786us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787823.688621:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 96 00000100:00100000:2.0:1785787823.708281:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787823.708631:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744893056 00000100:00100000:0.0:1785787823.708640:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744893056 00000100:00100000:0.0:1785787823.708695:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 97 00000100:00100000:0.0:1785787823.708704:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+11:13893:x1872533744893056:12345-192.168.203.53@tcp:101:mount.lustre.0 00010000:00010000:0.0:1785787823.708720:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787823.708736:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919052f5fe00/0xe2c2ff68a6e8586d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd768 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787823.708908:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919052f5fe00/0xe2c2ff68a6e8586d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd768 expref: 12 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787823.709026:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919052f5fe00/0xe2c2ff68a6e8586d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd768 expref: 12 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787823.709036:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919052f5fe00, rc 0) 00000100:00100000:0.0:1785787823.709137:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+12:13893:x1872533744893056:12345-192.168.203.53@tcp:101:mount.lustre.0 Request processed in 433us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787823.709145:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 97 00000100:00100000:0.0:1785787823.734116:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787823.740355:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744893184 00000100:00100000:2.0:1785787823.740368:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744893184 00000100:00100000:2.0:1785787823.741012:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 98 00000100:00100000:2.0:1785787823.741023:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077638850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+12:13893:x1872533744893184:12345-192.168.203.53@tcp:256:mount.lustre.0 20000000:01000000:2.0:1785787823.741048:0:14294:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1785787823.741072:0:14294:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1785787823.741076:0:14294:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1785787823.741078:0:14294:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1785787823.741081:0:14294:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1785787823.747754:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077638850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+12:13893:x1872533744893184:12345-192.168.203.53@tcp:256:mount.lustre.0 Request processed in 6393us (13304us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787823.747777:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 98 00000100:00100000:2.0:1785787823.752304:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787823.753663:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744893312 00000100:00100000:1.0:1785787823.753672:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744893312 00000100:00100000:1.0:1785787823.753724:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 99 00000100:00100000:1.0:1785787823.753733:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077638450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+12:13893:x1872533744893312:12345-192.168.203.53@tcp:101:mount.lustre.0 00010000:00010000:1.0:1785787823.753748:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787823.753770:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190443c5800/0xe2c2ff68a6e85874 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd76f expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787823.753813:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190443c5800/0xe2c2ff68a6e85874 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd76f expref: 13 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787823.753825:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190443c5800/0xe2c2ff68a6e85874 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd76f expref: 13 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787823.753873:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190443c5800, rc 0) 00000100:00100000:1.0:1785787823.753916:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077638450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+13:13893:x1872533744893312:12345-192.168.203.53@tcp:101:mount.lustre.0 Request processed in 185us (1618us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787823.753922:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 99 00000100:00100000:3.0:1785787823.756378:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787823.756632:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744893440 00000100:00100000:1.0:1785787823.756638:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744893440 00000100:00100000:1.0:1785787823.756673:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 100 00000100:00100000:1.0:1785787823.756679:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+13:13893:x1872533744893440:12345-192.168.203.53@tcp:501:mount.lustre.0 00000100:00100000:1.0:1785787823.756959:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+13:13893:x1872533744893440:12345-192.168.203.53@tcp:501:mount.lustre.0 Request processed in 279us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787823.756966:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 100 00000100:00100000:2.0:1785787823.762568:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787823.762731:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744893568 00000100:00100000:0.0:1785787823.762740:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744893568 00000100:00100000:0.0:1785787823.762785:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 101 00000100:00100000:0.0:1785787823.762793:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+13:13893:x1872533744893568:12345-192.168.203.53@tcp:503:mount.lustre.0 00000100:00100000:0.0:1785787823.763080:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+13:13893:x1872533744893568:12345-192.168.203.53@tcp:503:mount.lustre.0 Request processed in 287us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787823.763088:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 101 00000100:00100000:2.0:1785787823.770716:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787823.771277:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744893696 00000100:00100000:0.0:1785787823.771287:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744893696 00000100:00100000:0.0:1785787823.772402:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 102 00000100:00100000:0.0:1785787823.772414:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+13:13904:x1872533744893696:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1785787823.772849:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+13:13904:x1872533744893696:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 437us (2139us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787823.772865:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 102 00000100:00100000:3.0:1785787823.782812:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787823.782931:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744893824 00000100:00100000:1.0:1785787823.782940:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744893824 00000100:00100000:1.0:1785787823.782981:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 103 00000100:00100000:1.0:1785787823.782988:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077639050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+13:13904:x1872533744893824:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1785787823.783196:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077639050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+13:13904:x1872533744893824:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 208us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787823.783204:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 103 00000100:00100000:2.0:1785787823.791773:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787823.792079:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744893952 00000100:00100000:0.0:1785787823.792088:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744893952 00000100:00100000:0.0:1785787823.792132:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 10 00000100:00100000:0.0:1785787823.792139:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2387:x1872533744893952:12345-192.168.203.53@tcp:38:mount.lustre.0 00010000:00080000:0.0:1785787823.792164:0:14303:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 8da83796-a8e7-420f-9cfe-c8b5aabd12f4@192.168.203.53@tcp t0 exp 0000000000000000 cur 611 last 0 00000020:00000080:0.0:1785787823.792196:0:14303:0:(genops.c:1406:class_connect()) connect: client 8da83796-a8e7-420f-9cfe-c8b5aabd12f4, cookie 0xe2c2ff68a6e8587b 00000004:00100000:0.0:1785787823.792245:0:14303:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1785787823.792375:0:14303:0:(import.c:65:import_set_state_nolock()) ffff918f4120e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1785787823.792435:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+6:2387:x1872533744893952:12345-192.168.203.53@tcp:38:mount.lustre.0 Request processed in 295us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787823.792442:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 10 00000100:00100000:2.0:1785787823.804197:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787823.804337:0:15621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744894080 00000100:00100000:0.0:1785787823.804359:0:15621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744894080 00000100:00100000:0.0:1785787823.804420:0:15621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 11 00000100:00100000:0.0:1785787823.804428:0:15621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+6:0:x1872533744894080:12345-192.168.203.53@tcp:41:mount.lustre.0 00000004:00000024:0.0:1785787823.804487:0:15621:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:2.0:1785787823.804568:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785787823.804771:0:15621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+6:0:x1872533744894080:12345-192.168.203.53@tcp:41:mount.lustre.0 Request processed in 342us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787823.804780:0:15621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 11 00000100:00100000:3.0:1785787823.812814:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787823.812933:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744894208 00000100:00100000:0.0:1785787823.812941:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744894208 00000100:00100000:0.0:1785787823.812991:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 12 00000100:00100000:0.0:1785787823.812999:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076d89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+6:13893:x1872533744894208:12345-192.168.203.53@tcp:41:mount.lustre.0 00000004:00000024:0.0:1785787823.813027:0:14303:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1785787823.813097:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076d89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+6:13893:x1872533744894208:12345-192.168.203.53@tcp:41:mount.lustre.0 Request processed in 99us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787823.813105:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 12 00000100:00100000:2.0:1785787823.818067:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787823.818170:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744894336 00000100:00100000:3.0:1785787823.818179:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744894336 00000100:00100000:3.0:1785787823.818233:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 13 00000100:00100000:3.0:1785787823.818241:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+6:13893:x1872533744894336:12345-192.168.203.53@tcp:40:mount.lustre.0 00000100:00100000:3.0:1785787823.818364:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+6:13893:x1872533744894336:12345-192.168.203.53@tcp:40:mount.lustre.0 Request processed in 124us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787823.818371:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 13 00000100:00100000:1.0:1785787823.827804:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787823.827870:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787823.827889:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787823.827967:0:14938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744894464 00000100:00100000:2.0:1785787823.827975:0:14938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744894464 00000100:00100000:2.0:1785787823.828012:0:14938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744894592 00000100:00100000:2.0:1785787823.828015:0:14938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744894592 00000100:00100000:2.0:1785787823.828028:0:14938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 11 00000100:00100000:2.0:1785787823.828034:0:14938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2387:x1872533744894464:12345-192.168.203.53@tcp:8:mount.lustre.0 00010000:00080000:2.0:1785787823.828061:0:14938:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 8da83796-a8e7-420f-9cfe-c8b5aabd12f4@192.168.203.53@tcp t0 exp 0000000000000000 cur 611 last 0 00000020:00000080:2.0:1785787823.828087:0:14938:0:(genops.c:1406:class_connect()) connect: client 8da83796-a8e7-420f-9cfe-c8b5aabd12f4, cookie 0xe2c2ff68a6e85882 00002000:00100000:2.0:1785787823.828108:0:14938:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8da83796-a8e7-420f-9cfe-c8b5aabd12f4/ffff91907733f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113801 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1785787823.828125:0:14938:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1785787823.828226:0:14938:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1785787823.828251:0:14938:0:(import.c:65:import_set_state_nolock()) ffff91907733d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1785787823.828305:0:14938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+6:2387:x1872533744894464:12345-192.168.203.53@tcp:8:mount.lustre.0 Request processed in 270us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787823.828313:0:14938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 11 00000100:00100000:2.0:1785787823.828329:0:14938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 12 00000100:00100000:2.0:1785787823.828333:0:14938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2387:x1872533744894592:12345-192.168.203.53@tcp:8:mount.lustre.0 00010000:00080000:2.0:1785787823.828370:0:14938:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 8da83796-a8e7-420f-9cfe-c8b5aabd12f4@192.168.203.53@tcp t0 exp 0000000000000000 cur 611 last 0 00000020:00000080:2.0:1785787823.828384:0:14938:0:(genops.c:1406:class_connect()) connect: client 8da83796-a8e7-420f-9cfe-c8b5aabd12f4, cookie 0xe2c2ff68a6e85889 00002000:00100000:2.0:1785787823.828389:0:14938:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8da83796-a8e7-420f-9cfe-c8b5aabd12f4/ffff91907733e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113801 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1785787823.828394:0:14938:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1785787823.828586:0:14938:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1785787823.828599:0:14938:0:(import.c:65:import_set_state_nolock()) ffff91907733b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1785787823.828627:0:14938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+6:2387:x1872533744894592:12345-192.168.203.53@tcp:8:mount.lustre.0 Request processed in 292us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787823.828633:0:14938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 12 00000100:00100000:0.0:1785787823.829201:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744894720 00000100:00100000:0.0:1785787823.829205:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744894720 00000100:00100000:0.0:1785787823.829245:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 1 00000100:00100000:0.0:1785787823.829252:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+6:13893:x1872533744894720:12345-192.168.203.53@tcp:33:mount.lustre.0 00000004:00200000:0.0:1785787823.829859:0:14305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1785787823.829975:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+6:13893:x1872533744894720:12345-192.168.203.53@tcp:33:mount.lustre.0 Request processed in 723us (2104us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787823.829981:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 1 00010000:00010000:1.0:1785787824.130054:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785787824.152410:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787824.152745:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744894848 00000100:00100000:0.0:1785787824.152754:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744894848 00000100:00100000:0.0:1785787824.152817:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 14 00000100:00100000:0.0:1785787824.152856:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+6:13925:x1872533744894848:12345-192.168.203.53@tcp:101:mkdir.0 00010000:00010000:0.0:1785787824.152877:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787824.152899:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e000/0xe2c2ff68a6e85890 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd799 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787824.152965:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e85897 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787824.152978:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e85897 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787824.152991:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e85897 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785787824.153175:0:14303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1785787824.153185:0:14303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1785787824.153268:0:14303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e85897 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787824.153307:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e000/0xe2c2ff68a6e85890 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd799 expref: 8 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787824.153323:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e85897 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd799 expref: 7 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787824.153331:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919047f90100) 00010000:00010000:0.0:1785787824.153334:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1785787824.153336:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919052f5f200, rc 0) 00000100:00100000:0.0:1785787824.153401:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+7:13925:x1872533744894848:12345-192.168.203.53@tcp:101:mkdir.0 Request processed in 570us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787824.153407:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 14 00000001:00100000:0.0:1785787824.675327:0:6642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8da83796-a8e7-420f-9cfe-c8b5aabd12f4 00000001:00100000:0.0:1785787824.675422:0:6642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aabe278a-8cfd-4235-9dd3-056b28921491 00000040:00080000:0.0:1785787824.692037:0:14333:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1785787825.142997:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1785787825.670240:0:5843:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8da83796-a8e7-420f-9cfe-c8b5aabd12f4 00000001:00100000:1.0:1785787825.670252:0:5843:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of aabe278a-8cfd-4235-9dd3-056b28921491 00010000:00010000:3.0:1785787826.163035:0:15809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785787827.191018:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1785787827.579069:0:16176:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1785787828.211537:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787828.659203:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076d8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770060544:0@lo:400:kworker.0 00000100:00100000:3.0:1785787828.659267:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787828.659320:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3333:1872533770061056:0@lo:400:kworker.0 00000100:00100000:3.0:1785787828.659345:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787828.659369:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785787828.659374:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076d8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770060672:0@lo:400:kworker.0 00000100:00100000:3.0:1785787828.659397:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787828.659451:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770061056 00000100:00100000:3.0:1785787828.659458:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770061056 00000100:00100000:3.0:1785787828.659524:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1785787828.659533:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1872533770061056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787828.659578:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1872533770061056:12345-0@lo:400:kworker.0 Request processed in 47us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787828.659585:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1785787828.659620:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3333:1872533770061056:0@lo:400:kworker.0 00000100:00100000:0.0:1785787828.659716:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076d8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3335:1872533770060800:0@lo:400:kworker.0 00000100:00100000:0.0:1785787828.659744:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787828.659760:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1785787828.659765:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076d88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9a1da20-2955-44fa-b075-f73628199db8:3335:1872533770060416:0@lo:400:kworker.0 00000100:00100000:0.0:1785787828.659789:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787828.659806:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533770060928:0@lo:400:kworker.0 00000100:00100000:0.0:1785787828.659822:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787828.659867:0:15621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770060800 00000100:00100000:0.0:1785787828.659871:0:15621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770060800 00000100:00100000:0.0:1785787828.659891:0:15621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770060928 00000100:00100000:0.0:1785787828.659894:0:15621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770060928 00000100:00100000:0.0:1785787828.659920:0:15621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1785787828.659926:0:15621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3335:x1872533770060800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787828.659958:0:15621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3335:x1872533770060800:12345-0@lo:400:kworker.0 Request processed in 33us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787828.659964:0:15621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1785787828.659975:0:15621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1785787828.659980:0:15621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533770060928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787828.660001:0:15621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533770060928:12345-0@lo:400:kworker.0 Request processed in 22us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787828.660007:0:15621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1785787828.660024:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770060416 00000100:00100000:0.0:1785787828.660027:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770060416 00000100:00100000:0.0:1785787828.660045:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1785787828.660050:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077638050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+19:3335:x1872533770060416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787828.660075:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077638050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+19:3335:x1872533770060416:12345-0@lo:400:kworker.0 Request processed in 24us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787828.660081:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1785787828.660112:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076d88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9a1da20-2955-44fa-b075-f73628199db8:3335:1872533770060416:0@lo:400:kworker.0 00000100:00100000:0.0:1785787828.660122:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533770060928:0@lo:400:kworker.0 00000100:00100000:0.0:1785787828.660129:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076d8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3335:1872533770060800:0@lo:400:kworker.0 00000100:00100000:0.0:1785787828.660148:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785787828.660152:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff918f41390380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770061184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785787828.660195:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787828.660218:0:16007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770061184 00000100:00100000:0.0:1785787828.660221:0:16007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770061184 00000100:00100000:0.0:1785787828.660245:0:16007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1785787828.660252:0:16007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770061184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785787828.660276:0:16007:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785787828.660310:0:16007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770061184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787828.660316:0:16007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1785787828.660343:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff918f41390380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770061184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785787828.660751:0:14937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770060544 00000100:00100000:1.0:1785787828.660754:0:14937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770060544 00000100:00100000:1.0:1785787828.660782:0:14937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770060672 00000100:00100000:1.0:1785787828.660785:0:14937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770060672 00000100:00100000:1.0:1785787828.660795:0:14937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1785787828.660801:0:14937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770060544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787828.660854:0:14937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770060544:12345-0@lo:400:kworker.0 Request processed in 53us (1587us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787828.660866:0:14937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1785787828.660878:0:14937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1785787828.660883:0:14937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770060672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787828.660918:0:14937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770060672:12345-0@lo:400:kworker.0 Request processed in 35us (1520us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787828.660923:0:14937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1785787828.660951:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076d8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770060672:0@lo:400:kworker.0 00000100:00100000:1.0:1785787828.660958:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076d8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770060544:0@lo:400:kworker.0 00000100:00100000:2.0:1785787828.661366:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785787828.661377:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b48e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770061312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785787828.661405:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1785787828.661432:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1785787828.661436:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785787828.661438:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785787828.661464:0:14940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770061312 00000100:00100000:2.0:1785787828.661468:0:14940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770061312 00000100:00100000:2.0:1785787828.661501:0:14940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1785787828.661514:0:14940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770061312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785787828.661533:0:14940:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785787828.661563:0:14940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770061312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787828.661569:0:14940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1785787828.661595:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b48e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770061312:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1785787828.735041:0:7522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8da83796-a8e7-420f-9cfe-c8b5aabd12f4 00000100:00100000:1.0:1785787828.879469:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787828.879499:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787828.879535:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787828.879560:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787828.879591:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787828.879613:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787828.879635:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787828.879657:0:15621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744895488 00000100:00100000:1.0:1785787828.879666:0:15621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744895488 00000100:00100000:1.0:1785787828.879726:0:15621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744895104 00000100:00100000:1.0:1785787828.879729:0:15621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744895104 00000100:00100000:1.0:1785787828.879761:0:15621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 23 00000100:00100000:1.0:1785787828.879769:0:15621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+6:2391:x1872533744895488:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1785787828.879843:0:15621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+6:2391:x1872533744895488:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 60us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787828.879859:0:15621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 23 00000100:00100000:1.0:1785787828.879875:0:15621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 24 00000100:00100000:1.0:1785787828.879889:0:15621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aabe278a-8cfd-4235-9dd3-056b28921491+6:2391:x1872533744895104:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1785787828.879916:0:15621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aabe278a-8cfd-4235-9dd3-056b28921491+6:2391:x1872533744895104:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 28us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787828.879922:0:15621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 24 00000100:00100000:1.0:1785787828.879941:0:14939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744895232 00000100:00100000:1.0:1785787828.879944:0:14939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744895232 00000100:00100000:1.0:1785787828.879966:0:14939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744895744 00000100:00100000:1.0:1785787828.879969:0:14939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744895744 00000100:00100000:1.0:1785787828.879982:0:14939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744895360 00000100:00100000:1.0:1785787828.879985:0:14939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744895360 00000100:00100000:1.0:1785787828.879994:0:14939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744895616 00000100:00100000:1.0:1785787828.879996:0:14939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744895616 00000100:00100000:1.0:1785787828.880009:0:14939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 5 00000100:00100000:1.0:1785787828.880015:0:14939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aabe278a-8cfd-4235-9dd3-056b28921491+5:2391:x1872533744895232:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1785787828.880040:0:14939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aabe278a-8cfd-4235-9dd3-056b28921491+5:2391:x1872533744895232:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 25us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787828.880046:0:14939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 5 00000100:00100000:1.0:1785787828.880074:0:14939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 6 00000100:00100000:1.0:1785787828.880080:0:14939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+5:2391:x1872533744895744:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1785787828.880102:0:14939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+5:2391:x1872533744895744:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 23us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787828.880107:0:14939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 6 00000100:00100000:1.0:1785787828.880119:0:14939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 7 00000100:00100000:1.0:1785787828.880125:0:14939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aabe278a-8cfd-4235-9dd3-056b28921491+5:2391:x1872533744895360:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1785787828.880146:0:14939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aabe278a-8cfd-4235-9dd3-056b28921491+5:2391:x1872533744895360:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 22us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787828.880160:0:14939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 7 00000100:00100000:1.0:1785787828.880172:0:14939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 8 00000100:00100000:1.0:1785787828.880178:0:14939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+5:2391:x1872533744895616:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1785787828.880202:0:14939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+5:2391:x1872533744895616:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 25us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787828.880208:0:14939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 8 00000100:00080000:1.0:1785787828.880229:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785787828.880233:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785787828.880236:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785787828.880942:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744894976 00000100:00100000:0.0:1785787828.880947:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744894976 00000100:00100000:0.0:1785787828.880975:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 105 00000100:00100000:0.0:1785787828.880982:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+13:2391:x1872533744894976:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1785787828.881022:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+13:2391:x1872533744894976:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 41us (1563us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787828.881029:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 105 00010000:00010000:0.0:1785787829.239511:0:15809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787830.259510:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787831.284785:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787832.307080:0:15809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1785787832.447035:0:16327:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffb9b11540 20000000:00000080:3.0:1785787832.447051:0:16327:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9190762f9c00 uarg=0000000000000000 20000000:01000000:3.0:1785787832.447095:0:16327:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1785787832.447100:0:16327:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1785787832.447105:0:16327:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1785787832.449580:0:16328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1785787832.450473:0:16327:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1785787832.478803:0:16327:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1785787832.478954:0:16327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91905f902200/0xe2c2ff68a6e8589e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787832.478974:0:16327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91904677de00/0xe2c2ff68a6e85595 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e8558e expref: 18 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787832.478982:0:16327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91908206be00/0xe2c2ff68a6e855e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e855db expref: 18 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787832.478989:0:16327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919052f5f000/0xe2c2ff68a6e8571d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e85716 expref: 18 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787832.478998:0:16327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9190413a0a00/0xe2c2ff68a6e8583c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd70d expref: 12 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787832.479025:0:16327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9190443c5800/0xe2c2ff68a6e85874 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd76f expref: 12 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787832.479033:0:16327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91905f902200/0xe2c2ff68a6e8589e lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787832.482456:0:16327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9190443c5800/0xe2c2ff68a6e85874 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd76f expref: 12 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787832.482480:0:16327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9190443c5800/0xe2c2ff68a6e85874 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd76f expref: 12 pid: 14296 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787832.482496:0:16327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16327:1872533770061440:192.168.203.53@tcp:104: 00010000:00010000:3.0:1785787832.482625:0:16327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9190413a0a00/0xe2c2ff68a6e8583c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd70d expref: 12 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787832.482635:0:16327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9190413a0a00/0xe2c2ff68a6e8583c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd70d expref: 12 pid: 14295 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787832.482643:0:16327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16327:1872533770061568:192.168.203.53@tcp:104: 00010000:00010000:3.0:1785787832.482675:0:16327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919052f5f000/0xe2c2ff68a6e8571d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2c2ff68a6e85716 expref: 18 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787832.482683:0:16327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff919052f5f000/0xe2c2ff68a6e8571d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2c2ff68a6e85716 expref: 18 pid: 14295 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787832.482692:0:16327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16327:1872533770061696:0@lo:104: 00000100:00100000:3.0:1785787832.482728:0:16327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787832.482789:0:14285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770061696 00000100:00100000:3.0:1785787832.482796:0:14285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770061696 00000100:00100000:3.0:1785787832.482856:0:14285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1785787832.482865:0:14285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9a1da20-2955-44fa-b075-f73628199db8+3:16327:x1872533770061696:12345-0@lo:104: 00010000:00010000:3.0:1785787832.482877:0:14285:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff91904677d400/0xe2c2ff68a6e85716 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e8571d expref: -99 pid: 15607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787832.482920:0:14285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1785787832.482926:0:14285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9a1da20-2955-44fa-b075-f73628199db8+3:16327:x1872533770061696:12345-0@lo:104: Request processed in 64us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787832.482933:0:14285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1785787832.482968:0:16327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91908206be00/0xe2c2ff68a6e855e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2c2ff68a6e855db expref: 18 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787832.482976:0:16327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91908206be00/0xe2c2ff68a6e855e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2c2ff68a6e855db expref: 18 pid: 14296 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787832.482985:0:16327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16327:1872533770061824:0@lo:104: 00000100:00100000:3.0:1785787832.483008:0:16327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787832.483028:0:14285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770061824 00000100:00100000:3.0:1785787832.483032:0:14285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770061824 00000100:00100000:3.0:1785787832.483054:0:14285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1785787832.483060:0:14285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9a1da20-2955-44fa-b075-f73628199db8+3:16327:x1872533770061824:12345-0@lo:104: 00010000:00010000:3.0:1785787832.483068:0:14285:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e855db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e855e2 expref: -99 pid: 14935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787832.483098:0:14285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1785787832.483103:0:14285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9a1da20-2955-44fa-b075-f73628199db8+3:16327:x1872533770061824:12345-0@lo:104: Request processed in 44us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787832.483119:0:14285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1785787832.483149:0:16327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91904677de00/0xe2c2ff68a6e85595 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe2c2ff68a6e8558e expref: 18 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787832.483158:0:16327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91904677de00/0xe2c2ff68a6e85595 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe2c2ff68a6e8558e expref: 18 pid: 14296 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787832.483166:0:16327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16327:1872533770061952:0@lo:104: 00000100:00100000:3.0:1785787832.483193:0:16327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787832.483236:0:14285:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1785787832.483245:0:14285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770061952 00000100:00100000:3.0:1785787832.483248:0:14285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770061952 00000100:00100000:3.0:1785787832.483268:0:14285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1785787832.483274:0:14285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91904821e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9a1da20-2955-44fa-b075-f73628199db8+3:16327:x1872533770061952:12345-0@lo:104: 00010000:00010000:3.0:1785787832.483975:0:14285:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff919052f5fc00/0xe2c2ff68a6e8558e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e85595 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787832.484012:0:14285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1785787832.484018:0:14285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91904821e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9a1da20-2955-44fa-b075-f73628199db8+3:16327:x1872533770061952:12345-0@lo:104: Request processed in 744us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787832.484024:0:14285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1785787832.484083:0:16327:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190776bd780 going to sleep for 11 seconds 00000100:00100000:3.0:1785787832.484106:0:16327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16327:1872533770061696:0@lo:104: 00000100:00100000:3.0:1785787832.484114:0:16327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16327:1872533770061824:0@lo:104: 00000100:00100000:3.0:1785787832.484121:0:16327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16327:1872533770061952:0@lo:104: 00010000:00010000:1.0:1785787832.484303:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1785787832.484311:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff91904677d400/0xe2c2ff68a6e85716 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e8571d expref: -99 pid: 15607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787832.484319:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677d400 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:1.0:1785787832.484323:0:14290:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff91904677d400/0xe2c2ff68a6e85716 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2c2ff68a6e8571d expref: -99 pid: 15607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787832.484331:0:14290:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff91904677d400/0xe2c2ff68a6e85716 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2c2ff68a6e8571d expref: -99 pid: 15607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785787832.484347:0:14290:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff91904677d400/0xe2c2ff68a6e85716 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2c2ff68a6e8571d expref: -99 pid: 15607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785787832.484353:0:14290:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1785787832.484387:0:14290:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff91904677d400/0xe2c2ff68a6e85716 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e8571d expref: -99 pid: 15607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787832.484400:0:14290:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785787832.484435:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff91904677d400/0xe2c2ff68a6e85716 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e8571d expref: -99 pid: 15607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787832.484442:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff91904677d400/0xe2c2ff68a6e85716 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e8571d expref: -99 pid: 15607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787832.484454:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1785787832.484457:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e855db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e855e2 expref: -99 pid: 14935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787832.484462:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903800 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:1.0:1785787832.484465:0:14290:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e855db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2c2ff68a6e855e2 expref: -99 pid: 14935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787832.484471:0:14290:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e855db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2c2ff68a6e855e2 expref: -99 pid: 14935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785787832.484477:0:14290:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e855db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2c2ff68a6e855e2 expref: -99 pid: 14935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785787832.484482:0:14290:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1785787832.484494:0:14290:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e855db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e855e2 expref: -99 pid: 14935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787832.484499:0:14290:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785787832.484513:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e855db lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e855e2 expref: -99 pid: 14935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787832.484520:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff91905f903800/0xe2c2ff68a6e855db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e855e2 expref: -99 pid: 14935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787832.484534:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785787832.484537:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff919052f5fc00/0xe2c2ff68a6e8558e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe2c2ff68a6e85595 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787832.484542:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919052f5fc00 already unused, calling callback (ffffffffc1d68c20) 10000000:00010000:1.0:1785787832.484544:0:14290:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff919052f5fc00/0xe2c2ff68a6e8558e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe2c2ff68a6e85595 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787832.484551:0:14290:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff919052f5fc00/0xe2c2ff68a6e8558e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe2c2ff68a6e85595 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785787832.484557:0:14290:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff919052f5fc00/0xe2c2ff68a6e8558e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe2c2ff68a6e85595 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785787832.484561:0:14290:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1785787832.484573:0:14290:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff919052f5fc00/0xe2c2ff68a6e8558e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e85595 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787832.484578:0:14290:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785787832.484583:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff919052f5fc00/0xe2c2ff68a6e8558e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e85595 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787832.484589:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff919052f5fc00/0xe2c2ff68a6e8558e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe2c2ff68a6e85595 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787832.484612:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787832.484614:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787832.484615:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785787832.484622:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785787832.484638:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b48f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9a1da20-2955-44fa-b075-f73628199db8:3336:1872533770062080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785787832.484670:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787832.484705:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b48d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9a1da20-2955-44fa-b075-f73628199db8:3333:1872533770062208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785787832.484726:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787832.484742:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785787832.484748:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b48d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9a1da20-2955-44fa-b075-f73628199db8:3333:1872533770062336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785787832.484769:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787832.484801:0:14287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770062080 00000100:00100000:1.0:1785787832.484805:0:14287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770062080 00010000:00010000:1.0:1785787832.484822:0:14287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919052f5f000/0xe2c2ff68a6e8571d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e85716 expref: 19 pid: 14295 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787832.484856:0:14287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770062208 00000100:00100000:1.0:1785787832.484858:0:14287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770062208 00010000:00010000:1.0:1785787832.484869:0:14287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91908206be00/0xe2c2ff68a6e855e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e855db expref: 20 pid: 14296 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787832.484879:0:14287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770062336 00000100:00100000:1.0:1785787832.484881:0:14287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770062336 00010000:00010000:1.0:1785787832.484891:0:14287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91904677de00/0xe2c2ff68a6e85595 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e8558e expref: 21 pid: 14296 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787832.484901:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1785787832.484906:0:14287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a1da20-2955-44fa-b075-f73628199db8+21:3336:x1872533770062080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785787832.484915:0:14287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785787832.484920:0:14287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919052f5f000/0xe2c2ff68a6e8571d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e85716 expref: 21 pid: 14295 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787832.484928:0:14287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919052f5f000/0xe2c2ff68a6e8571d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2c2ff68a6e85716 expref: 21 pid: 14295 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787832.484946:0:14287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919052f5f000/0xe2c2ff68a6e8571d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2c2ff68a6e85716 expref: 21 pid: 14295 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787832.484958:0:14287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785787832.484986:0:14287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a1da20-2955-44fa-b075-f73628199db8+20:3336:x1872533770062080:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787832.484992:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1785787832.485006:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1785787832.485012:0:14287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a1da20-2955-44fa-b075-f73628199db8+19:3333:x1872533770062208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785787832.485019:0:14287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785787832.485023:0:14287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91908206be00/0xe2c2ff68a6e855e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e855db expref: 19 pid: 14296 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787832.485031:0:14287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91908206be00/0xe2c2ff68a6e855e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2c2ff68a6e855db expref: 19 pid: 14296 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787832.485040:0:14287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91908206be00/0xe2c2ff68a6e855e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2c2ff68a6e855db expref: 19 pid: 14296 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787832.485049:0:14287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785787832.485074:0:14287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a1da20-2955-44fa-b075-f73628199db8+18:3333:x1872533770062208:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787832.485080:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1785787832.485093:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1785787832.485098:0:14287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd6c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a1da20-2955-44fa-b075-f73628199db8+17:3333:x1872533770062336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785787832.485105:0:14287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785787832.485109:0:14287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91904677de00/0xe2c2ff68a6e85595 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe2c2ff68a6e8558e expref: 17 pid: 14296 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787832.485124:0:14287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91904677de00/0xe2c2ff68a6e85595 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe2c2ff68a6e8558e expref: 17 pid: 14296 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787832.485134:0:14287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91904677de00/0xe2c2ff68a6e85595 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe2c2ff68a6e8558e expref: 17 pid: 14296 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787832.485142:0:14287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785787832.485165:0:14287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd6c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a1da20-2955-44fa-b075-f73628199db8+16:3333:x1872533770062336:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787832.485170:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1785787832.485235:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b48f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9a1da20-2955-44fa-b075-f73628199db8:3336:1872533770062080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785787832.485257:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b48d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9a1da20-2955-44fa-b075-f73628199db8:3333:1872533770062336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785787832.485264:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b48d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9a1da20-2955-44fa-b075-f73628199db8:3333:1872533770062208:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785787832.485769:0:15809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785787832.513703:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787832.513801:0:14287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744895872 00000100:00100000:0.0:1785787832.513809:0:14287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744895872 00010000:00010000:0.0:1785787832.513882:0:14287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9190443c5800/0xe2c2ff68a6e85874 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd76f expref: 13 pid: 14296 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787832.513909:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 7 00000100:00100000:0.0:1785787832.513917:0:14287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+13:2390:x1872533744895872:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785787832.513946:0:14287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785787832.513953:0:14287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9190443c5800/0xe2c2ff68a6e85874 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd76f expref: 13 pid: 14296 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787832.513965:0:14287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9190443c5800/0xe2c2ff68a6e85874 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd76f expref: 13 pid: 14296 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787832.513985:0:14287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785787832.514041:0:14287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+13:2390:x1872533744895872:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 123us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787832.514048:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 7 00010000:00010000:3.0:1785787832.514459:0:16327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9190443c5800/0xe2c2ff68a6e85874 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd76f expref: 12 pid: 14296 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787832.514484:0:16327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16327:1872533770061440:192.168.203.53@tcp:104: 00000100:00100000:3.0:1785787832.514495:0:16327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16327:1872533770061568:192.168.203.53@tcp:104: 00010000:00010000:3.0:1785787832.514522:0:16327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91905f902200/0xe2c2ff68a6e8589e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787832.514691:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787832.514753:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744896000 00000100:00100000:2.0:1785787832.514759:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744896000 00010000:00010000:2.0:1785787832.514776:0:14288:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9190413a0a00/0xe2c2ff68a6e8583c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd70d expref: 12 pid: 14295 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787832.514802:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 8 00000100:00100000:2.0:1785787832.514808:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+12:2390:x1872533744896000:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785787832.514816:0:14288:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785787832.514820:0:14288:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9190413a0a00/0xe2c2ff68a6e8583c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd70d expref: 12 pid: 14295 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787832.514857:0:14288:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9190413a0a00/0xe2c2ff68a6e8583c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd70d expref: 12 pid: 14295 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787832.514868:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9190413a0a00/0xe2c2ff68a6e8583c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd70d expref: 12 pid: 14295 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787832.514879:0:14288:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91905f902200/0xe2c2ff68a6e8589e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787832.514886:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91905f902200/0xe2c2ff68a6e8589e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787832.514905:0:14288:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91905f902200/0xe2c2ff68a6e8589e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787832.514912:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91905f902200/0xe2c2ff68a6e8589e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787832.514918:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91905f902200/0xe2c2ff68a6e8589e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787832.514925:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91905f902200/0xe2c2ff68a6e8589e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787832.514931:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f902200 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785787832.514935:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91905f902200/0xe2c2ff68a6e8589e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787832.514943:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91905f902200/0xe2c2ff68a6e8589e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787832.514953:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91905f902200/0xe2c2ff68a6e8589e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787832.514962:0:14288:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785787832.514990:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+11:2390:x1872533744896000:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 181us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787832.514998:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 8 00010000:00010000:3.0:1785787832.515310:0:16327:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91905f902200/0xe2c2ff68a6e8589e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787832.515318:0:16327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91905f902200/0xe2c2ff68a6e8589e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787832.515324:0:16327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91905f902200/0xe2c2ff68a6e8589e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787833.332382:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1785787833.716031:0:14298:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1785787833.716038:0:14298:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff919077aad800 from 10 10000000:01000000:1.0:1785787833.716043:0:14298:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1785787833.716095:0:14298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff9190443c4000/0xe2c2ff68a6e858a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787833.716108:0:14298:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff9190443c4000/0xe2c2ff68a6e858a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787833.716120:0:14298:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff9190443c4000/0xe2c2ff68a6e858a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787833.716147:0:14298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b48d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9a1da20-2955-44fa-b075-f73628199db8:14298:1872533770062464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1785787833.716233:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787833.716293:0:14298:0:(client.c:2702:ptlrpc_set_wait()) set ffff919077954e40 going to sleep for 11 seconds 00000100:00100000:3.0:1785787833.716354:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770062464 00000100:00100000:3.0:1785787833.716362:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770062464 00000100:00100000:3.0:1785787833.716429:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1785787833.716440:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+16:14298:x1872533770062464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785787833.716457:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787833.716474:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91905f902200/0xe2c2ff68a6e858ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e858a5 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787833.716501:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91905f902200/0xe2c2ff68a6e858ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e858a5 expref: 17 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787833.716512:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91905f902200/0xe2c2ff68a6e858ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e858a5 expref: 17 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787833.716530:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f902200, rc 0) 00000100:00100000:3.0:1785787833.716573:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+17:14298:x1872533770062464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787833.716581:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1785787833.716629:0:14298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b48d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9a1da20-2955-44fa-b075-f73628199db8:14298:1872533770062464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785787833.716645:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff9190443c4000/0xe2c2ff68a6e858a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e858ac expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787833.716655:0:14298:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff9190443c4000/0xe2c2ff68a6e858a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e858ac expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787833.716711:0:14298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9a1da20-2955-44fa-b075-f73628199db8:14298:1872533770062592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785787833.716737:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787833.716751:0:14298:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190776bd180 going to sleep for 11 seconds 00000100:00100000:3.0:1785787833.716764:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770062592 00000100:00100000:3.0:1785787833.716767:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770062592 00000100:00100000:3.0:1785787833.716788:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1785787833.716794:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+17:14298:x1872533770062592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785787833.717094:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+17:14298:x1872533770062592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 299us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787833.717102:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1785787833.717132:0:14298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9a1da20-2955-44fa-b075-f73628199db8:14298:1872533770062592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785787833.717160:0:14298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9a1da20-2955-44fa-b075-f73628199db8:14298:1872533770062720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785787833.717207:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787833.717226:0:14298:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190776bd180 going to sleep for 11 seconds 00000100:00100000:3.0:1785787833.717237:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770062720 00000100:00100000:3.0:1785787833.717240:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770062720 00000100:00100000:3.0:1785787833.717260:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1785787833.717266:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+17:14298:x1872533770062720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785787833.717425:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+17:14298:x1872533770062720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787833.717431:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1785787833.717468:0:14298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9a1da20-2955-44fa-b075-f73628199db8:14298:1872533770062720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1785787833.718257:0:16351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1785787833.718310:0:14298:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1785787833.718322:0:14298:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1785787833.718329:0:14298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff9190443c4000/0xe2c2ff68a6e858a5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e858ac expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787833.718339:0:14298:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff9190443c4000/0xe2c2ff68a6e858a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e858ac expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785787833.718348:0:14298:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1785787833.718351:0:14298:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff91904e8a5800 from 10 10000000:01000000:3.0:1785787833.718354:0:14298:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1785787833.718370:0:14298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff91905f902c00/0xe2c2ff68a6e858b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787833.718377:0:14298:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff91905f902c00/0xe2c2ff68a6e858b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787833.718386:0:14298:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff91905f902c00/0xe2c2ff68a6e858b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787833.718421:0:14298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9a1da20-2955-44fa-b075-f73628199db8:14298:1872533770062848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1785787833.718447:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787833.718460:0:14298:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190776bd000 going to sleep for 11 seconds 00000100:00100000:3.0:1785787833.718471:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770062848 00000100:00100000:3.0:1785787833.718474:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770062848 00000100:00100000:3.0:1785787833.718493:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1785787833.718498:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077638c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+17:14298:x1872533770062848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785787833.718506:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787833.718515:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91905f902a00/0xe2c2ff68a6e858ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e858b3 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787833.718530:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91905f902a00/0xe2c2ff68a6e858ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e858b3 expref: 18 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787833.718539:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91905f902a00/0xe2c2ff68a6e858ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e858b3 expref: 18 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787833.718547:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f902a00, rc 0) 00000100:00100000:3.0:1785787833.718570:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077638c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+18:14298:x1872533770062848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 72us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787833.718577:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1785787833.718602:0:14298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9a1da20-2955-44fa-b075-f73628199db8:14298:1872533770062848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785787833.718612:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff91905f902c00/0xe2c2ff68a6e858b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e858ba expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787833.718620:0:14298:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff91905f902c00/0xe2c2ff68a6e858b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e858ba expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787833.718658:0:14298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9a1da20-2955-44fa-b075-f73628199db8:14298:1872533770062976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785787833.718682:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787833.718694:0:14298:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190776bd000 going to sleep for 11 seconds 00000100:00100000:3.0:1785787833.718704:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770062976 00000100:00100000:3.0:1785787833.718707:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770062976 00000100:00100000:3.0:1785787833.718723:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1785787833.718728:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907763b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+18:14298:x1872533770062976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785787833.718875:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907763b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+18:14298:x1872533770062976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 146us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787833.718882:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1785787833.718907:0:14298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9a1da20-2955-44fa-b075-f73628199db8:14298:1872533770062976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785787833.718925:0:14298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9a1da20-2955-44fa-b075-f73628199db8:14298:1872533770063104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785787833.718959:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787833.718970:0:14298:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190776bd000 going to sleep for 11 seconds 00000100:00100000:3.0:1785787833.718980:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770063104 00000100:00100000:3.0:1785787833.718982:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770063104 00000100:00100000:3.0:1785787833.719001:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1785787833.719008:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077639c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+18:14298:x1872533770063104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785787833.719110:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077639c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+18:14298:x1872533770063104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787833.719117:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1785787833.719155:0:14298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9a1da20-2955-44fa-b075-f73628199db8:14298:1872533770063104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1785787833.732134:0:16352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1785787833.732335:0:14298:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1785787833.732359:0:14298:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1785787833.732373:0:14298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff91905f902c00/0xe2c2ff68a6e858b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e858ba expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787833.732397:0:14298:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff91905f902c00/0xe2c2ff68a6e858b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e858ba expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785787833.732419:0:14298:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1785787833.732422:0:14298:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff91905f91f800 from 10 10000000:01000000:2.0:1785787833.732425:0:14298:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1785787833.732468:0:14298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff9190413a0e00/0xe2c2ff68a6e858c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787833.732476:0:14298:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff9190413a0e00/0xe2c2ff68a6e858c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787833.732487:0:14298:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff9190413a0e00/0xe2c2ff68a6e858c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787833.732515:0:14298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bd99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9a1da20-2955-44fa-b075-f73628199db8:14298:1872533770063232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1785787833.732592:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787833.732643:0:14298:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190507eac00 going to sleep for 11 seconds 00000100:00100000:1.0:1785787833.733500:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770063232 00000100:00100000:1.0:1785787833.733508:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770063232 00000100:00100000:1.0:1785787833.733559:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1785787833.733570:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077639450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+18:14298:x1872533770063232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1785787833.733586:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787833.733601:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190443c4200/0xe2c2ff68a6e858c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe2c2ff68a6e858c1 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787833.733626:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190443c4200/0xe2c2ff68a6e858c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe2c2ff68a6e858c1 expref: 19 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787833.733637:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190443c4200/0xe2c2ff68a6e858c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe2c2ff68a6e858c1 expref: 19 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787833.733647:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190443c4200, rc 0) 00000100:00100000:1.0:1785787833.733696:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077639450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+19:14298:x1872533770063232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (1103us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787833.733704:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1785787833.733806:0:14298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bd99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9a1da20-2955-44fa-b075-f73628199db8:14298:1872533770063232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785787833.733823:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff9190413a0e00/0xe2c2ff68a6e858c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e858c8 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787833.733854:0:14298:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff9190413a0e00/0xe2c2ff68a6e858c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe2c2ff68a6e858c8 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787833.733911:0:14298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bd99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9a1da20-2955-44fa-b075-f73628199db8:14298:1872533770063360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1785787833.733936:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787833.733964:0:14298:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190507eac00 going to sleep for 11 seconds 00000100:00100000:3.0:1785787833.734765:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770063360 00000100:00100000:3.0:1785787833.734777:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770063360 00000100:00100000:3.0:1785787833.734807:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1785787833.734814:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+19:14298:x1872533770063360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785787833.735094:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+19:14298:x1872533770063360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 280us (1156us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787833.735101:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1785787833.738892:0:14298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bd99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9a1da20-2955-44fa-b075-f73628199db8:14298:1872533770063360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785787833.738961:0:14298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076eec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9a1da20-2955-44fa-b075-f73628199db8:14298:1872533770063488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785787833.739030:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787833.739059:0:14298:0:(client.c:2702:ptlrpc_set_wait()) set ffff91905159dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1785787833.739711:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770063488 00000100:00100000:1.0:1785787833.739719:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770063488 00000100:00100000:1.0:1785787833.739775:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1785787833.739784:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+19:14298:x1872533770063488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785787833.740023:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+19:14298:x1872533770063488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 240us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787833.740031:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1785787833.740342:0:14298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076eec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9a1da20-2955-44fa-b075-f73628199db8:14298:1872533770063488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1785787833.742059:0:16353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1785787833.742464:0:14298:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1785787833.742488:0:14298:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1785787833.742499:0:14298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff9190413a0e00/0xe2c2ff68a6e858c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e858c8 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787833.742511:0:14298:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff9190413a0e00/0xe2c2ff68a6e858c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe2c2ff68a6e858c8 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787833.779563:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bd99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770063744:0@lo:400:kworker.0 00000100:00100000:2.0:1785787833.779647:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787833.779681:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bd99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3336:1872533770064256:0@lo:400:kworker.0 00000100:00100000:2.0:1785787833.779707:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787833.779708:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bd98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9a1da20-2955-44fa-b075-f73628199db8:3335:1872533770063616:0@lo:400:kworker.0 00000100:00100000:2.0:1785787833.779745:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bd99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770063872:0@lo:400:kworker.0 00000100:00100000:3.0:1785787833.779756:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787833.779777:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787833.779800:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bd9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533770064128:0@lo:400:kworker.0 00000100:00100000:2.0:1785787833.779814:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785787833.779822:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bd99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1872533770064000:0@lo:400:kworker.0 00000100:00100000:3.0:1785787833.779853:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787833.779881:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787833.779923:0:14939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770063744 00000100:00100000:2.0:1785787833.779930:0:14939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770063744 00000100:00100000:2.0:1785787833.779986:0:14939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770063872 00000100:00100000:2.0:1785787833.779988:0:14939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770063872 00000100:00100000:2.0:1785787833.780003:0:14939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1785787833.780011:0:14939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770063744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787833.780059:0:14939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770063744:12345-0@lo:400:kworker.0 Request processed in 48us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787833.780066:0:14939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1785787833.780082:0:14939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1785787833.780087:0:14939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770063872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787833.780111:0:14939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770063872:12345-0@lo:400:kworker.0 Request processed in 24us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787833.780116:0:14939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1785787833.780637:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770063616 00000100:00100000:0.0:1785787833.780642:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770063616 00000100:00100000:0.0:1785787833.780670:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1785787833.780677:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905fafa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+19:3335:x1872533770063616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787833.780715:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905fafa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9a1da20-2955-44fa-b075-f73628199db8+19:3335:x1872533770063616:12345-0@lo:400:kworker.0 Request processed in 39us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787833.780721:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1785787833.781046:0:3334:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785787833.781056:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076eec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770064384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785787833.781090:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787833.781118:0:14941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770064384 00000100:00100000:0.0:1785787833.781122:0:14941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770064384 00000100:00100000:0.0:1785787833.781150:0:14941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1785787833.781157:0:14941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770064384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785787833.781185:0:14941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785787833.781232:0:14941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770064384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787833.781238:0:14941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1785787833.781319:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bd98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9a1da20-2955-44fa-b075-f73628199db8:3335:1872533770063616:0@lo:400:kworker.0 00000100:00100000:3.0:1785787833.781863:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770064256 00000100:00100000:3.0:1785787833.781869:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770064256 00000100:00100000:3.0:1785787833.781909:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770064128 00000100:00100000:3.0:1785787833.781912:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770064128 00000100:00100000:3.0:1785787833.781928:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770064000 00000100:00100000:3.0:1785787833.781931:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770064000 00000100:00100000:3.0:1785787833.781949:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1785787833.781960:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3336:x1872533770064256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787833.782020:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3336:x1872533770064256:12345-0@lo:400:kworker.0 Request processed in 62us (2313us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787833.782031:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1785787833.782046:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1785787833.782055:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533770064128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787833.782093:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533770064128:12345-0@lo:400:kworker.0 Request processed in 39us (2240us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787833.782107:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1785787833.782120:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1785787833.782135:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1872533770064000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787833.782164:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1872533770064000:12345-0@lo:400:kworker.0 Request processed in 30us (2283us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787833.782176:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1785787833.782206:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bd9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533770064128:0@lo:400:kworker.0 00000100:00100000:1.0:1785787833.785048:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076eec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770064384:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1785787833.787589:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1785787833.787597:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785787833.787600:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785787833.787652:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bd99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1872533770064000:0@lo:400:kworker.0 00000100:00100000:2.0:1785787833.787666:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bd99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770063872:0@lo:400:kworker.0 00000100:00100000:2.0:1785787833.787683:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785787833.787693:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770064512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785787833.787753:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787833.787823:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bd99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770063744:0@lo:400:kworker.0 00000100:00100000:2.0:1785787833.787856:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bd99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3336:1872533770064256:0@lo:400:kworker.0 00000100:00100000:3.0:1785787833.789476:0:16007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770064512 00000100:00100000:3.0:1785787833.789488:0:16007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770064512 00000100:00100000:3.0:1785787833.789547:0:16007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1785787833.789557:0:16007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770064512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785787833.789604:0:16007:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785787833.789660:0:16007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770064512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (1905us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787833.789668:0:16007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1785787833.790963:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770064512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785787833.990695:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787833.990740:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787833.990772:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787833.990793:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787833.990813:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787833.990864:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787833.990905:0:14939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744896384 00000100:00100000:0.0:1785787833.990916:0:14939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744896384 00000100:00100000:0.0:1785787833.990976:0:14939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744896896 00000100:00100000:0.0:1785787833.990979:0:14939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744896896 00000100:00100000:0.0:1785787833.990989:0:14939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744896512 00000100:00100000:0.0:1785787833.990991:0:14939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744896512 00000100:00100000:0.0:1785787833.991006:0:14939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 11 00000100:00100000:0.0:1785787833.991015:0:14939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aabe278a-8cfd-4235-9dd3-056b28921491+5:2390:x1872533744896384:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1785787833.991255:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744896256 00000100:00100000:3.0:1785787833.991260:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744896256 00000100:00100000:3.0:1785787833.991295:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744896640 00000100:00100000:3.0:1785787833.991298:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744896640 00000100:00100000:3.0:1785787833.991315:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 28 00000100:00100000:3.0:1785787833.991321:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aabe278a-8cfd-4235-9dd3-056b28921491+6:2391:x1872533744896256:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1785787833.991401:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aabe278a-8cfd-4235-9dd3-056b28921491+6:2391:x1872533744896256:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 79us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787833.991418:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 28 00000100:00100000:3.0:1785787833.991436:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 29 00000100:00100000:3.0:1785787833.991442:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+6:2390:x1872533744896640:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1785787833.991469:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+6:2390:x1872533744896640:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 27us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787833.991485:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 29 00000100:00100000:1.0:1785787833.991709:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744896128 00000100:00100000:1.0:1785787833.991715:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744896128 00000100:00100000:1.0:1785787833.991747:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 116 00000100:00100000:1.0:1785787833.991754:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+11:2390:x1872533744896128:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1785787833.991788:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+11:2390:x1872533744896128:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 35us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787833.991794:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 116 00000100:00100000:0.0:1785787833.992207:0:14939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aabe278a-8cfd-4235-9dd3-056b28921491+5:2390:x1872533744896384:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 1192us (1434us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787833.992215:0:14939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 11 00000100:00100000:0.0:1785787833.992238:0:14939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 12 00000100:00100000:0.0:1785787833.992245:0:14939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+5:2390:x1872533744896896:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1785787833.992273:0:14939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+5:2390:x1872533744896896:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 29us (1459us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787833.992279:0:14939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 12 00000100:00100000:0.0:1785787833.992290:0:14939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 13 00000100:00100000:0.0:1785787833.992296:0:14939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aabe278a-8cfd-4235-9dd3-056b28921491+5:2391:x1872533744896512:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1785787833.992315:0:14939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aabe278a-8cfd-4235-9dd3-056b28921491+5:2391:x1872533744896512:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 20us (1452us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787833.992321:0:14939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 13 00000100:00080000:0.0:1785787833.992349:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785787833.992354:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785787833.992356:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785787834.007209:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787834.007367:0:14939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744896768 00000100:00100000:2.0:1785787834.007380:0:14939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744896768 00000100:00100000:2.0:1785787834.007476:0:14939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 14 00000100:00100000:2.0:1785787834.007487:0:14939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+5:2391:x1872533744896768:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:2.0:1785787834.007571:0:14939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+5:2391:x1872533744896768:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 86us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787834.007579:0:14939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 14 00000100:00080000:0.0:1785787834.008154:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785787834.313414:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787834.313457:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744897024 00000100:00100000:0.0:1785787834.313468:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744897024 00000100:00100000:0.0:1785787834.313520:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 117 00000100:00100000:0.0:1785787834.313529:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905fafa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+11:13779:x1872533744897024:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785787834.313550:0:14294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787834.313571:0:14294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919052f5ec00/0xe2c2ff68a6e858cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd7a0 expref: -99 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787834.313603:0:14294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919052f5ec00/0xe2c2ff68a6e858cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7a0 expref: 12 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787834.313627:0:14294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919052f5ec00/0xe2c2ff68a6e858cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7a0 expref: 12 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787834.313638:0:14294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919052f5ec00, rc 0) 00000100:00100000:0.0:1785787834.313696:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905fafa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+12:13779:x1872533744897024:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 Request processed in 168us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787834.313702:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 117 00000100:00100000:2.0:1785787834.326091:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787834.326241:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744897152 00000100:00100000:0.0:1785787834.326253:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744897152 00000100:00100000:0.0:1785787834.326316:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 118 00000100:00100000:0.0:1785787834.326327:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+12:13779:x1872533744897152:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785787834.326659:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+12:13779:x1872533744897152:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 Request processed in 333us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787834.326668:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 118 00000100:00100000:0.0:1785787834.345178:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787834.345314:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744897280 00000100:00100000:2.0:1785787834.345328:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744897280 00000100:00100000:2.0:1785787834.345399:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 119 00000100:00100000:2.0:1785787834.345422:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905fafac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+12:13779:x1872533744897280:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1785787834.345695:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905fafac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+12:13779:x1872533744897280:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 Request processed in 275us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787834.345704:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 119 00010000:00010000:2.0:1785787834.364954:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785787834.365885:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787834.377004:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744897408 00000100:00100000:2.0:1785787834.377023:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744897408 00000100:00100000:2.0:1785787834.377102:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 120 00000100:00100000:2.0:1785787834.377111:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905fafb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+12:13779:x1872533744897408:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785787834.377132:0:14294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787834.377153:0:14294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9190413a1400/0xe2c2ff68a6e858d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd7a7 expref: -99 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787834.377185:0:14294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9190413a1400/0xe2c2ff68a6e858d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7a7 expref: 13 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787834.377196:0:14294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9190413a1400/0xe2c2ff68a6e858d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7a7 expref: 13 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787834.377206:0:14294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190413a1400, rc 0) 00000100:00100000:2.0:1785787834.377284:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905fafb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+13:13779:x1872533744897408:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 Request processed in 174us (12502us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787834.377292:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 120 00000100:00100000:1.0:1785787834.382271:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787834.385019:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744897536 00000100:00100000:3.0:1785787834.385045:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744897536 00000100:00100000:3.0:1785787834.385125:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 121 00000100:00100000:3.0:1785787834.385137:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905fafb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+13:13779:x1872533744897536:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785787834.385501:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905fafb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+13:13779:x1872533744897536:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 Request processed in 365us (3238us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787834.385511:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 121 00000100:00100000:0.0:1785787834.404103:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787834.404219:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744897664 00000100:00100000:1.0:1785787834.404233:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744897664 00000100:00100000:1.0:1785787834.404296:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 122 00000100:00100000:1.0:1785787834.404307:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+13:13779:x1872533744897664:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785787834.404569:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+13:13779:x1872533744897664:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 Request processed in 264us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787834.404579:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 122 00000040:00080000:3.0:1785787834.935157:0:14333:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1785787835.378956:0:15809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785787836.405727:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787837.427435:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785787837.773483:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787837.775204:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744897792 00000100:00100000:3.0:1785787837.775215:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744897792 00000100:00100000:3.0:1785787837.775289:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 15 00000100:00100000:3.0:1785787837.775299:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aabe278a-8cfd-4235-9dd3-056b28921491+6:14435:x1872533744897792:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785787837.775317:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787837.775338:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e858dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd7ae expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787837.775404:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e858e4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787837.775417:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e858e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787837.775429:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e858e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787837.775442:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903400/0xe2c2ff68a6e858eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787837.775460:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903400/0xe2c2ff68a6e858eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787837.775467:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903400/0xe2c2ff68a6e858eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1785787837.775616:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1785787837.776016:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e858f2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787837.776026:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e858f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787837.776033:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e858f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785787837.780612:0:14303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1785787837.780620:0:14303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1785787837.780790:0:14303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e858f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787837.780807:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e858e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787837.780814:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e858e4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787837.780822:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e858e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787837.780843:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f902600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787837.780847:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e858e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787837.780862:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e858e4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787837.780878:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919047f90100) 00010000:00010000:3.0:1785787837.780881:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787837.780886:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e858e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787837.780893:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e858e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787837.780906:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903400/0xe2c2ff68a6e858eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787837.780912:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903400/0xe2c2ff68a6e858eb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787837.780919:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903400/0xe2c2ff68a6e858eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787837.780924:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787837.780927:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903400/0xe2c2ff68a6e858eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787837.780932:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903400/0xe2c2ff68a6e858eb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787837.780938:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff919055acd400) 00010000:00010000:3.0:1785787837.780940:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787837.780942:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903400/0xe2c2ff68a6e858eb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787837.780958:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903400/0xe2c2ff68a6e858eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787837.781001:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e858dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7ae expref: 8 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787837.781016:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903600/0xe2c2ff68a6e858f2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7ae expref: 7 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787837.781024:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff919055acd100) 00010000:00010000:3.0:1785787837.781026:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785787837.781028:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f903600, rc 0) 00000100:00100000:3.0:1785787837.781285:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aabe278a-8cfd-4235-9dd3-056b28921491+7:14435:x1872533744897792:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 5986us (7808us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787837.781295:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 15 00000100:00100000:1.0:1785787837.804720:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787837.804812:0:15621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744898048 00000100:00100000:2.0:1785787837.804821:0:15621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744898048 00000100:00100000:2.0:1785787837.804911:0:15621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 16 00000100:00100000:2.0:1785787837.804920:0:15621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aabe278a-8cfd-4235-9dd3-056b28921491+7:14435:x1872533744898048:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1785787837.804941:0:15621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787837.804959:0:15621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a0a00/0xe2c2ff68a6e858f9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd7b5 expref: -99 pid: 15621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787837.805061:0:15621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1200/0xe2c2ff68a6e85900 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787837.805074:0:15621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1200/0xe2c2ff68a6e85900 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787837.805085:0:15621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1200/0xe2c2ff68a6e85900 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787837.805112:0:15621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a0600/0xe2c2ff68a6e85907 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787837.805120:0:15621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a0600/0xe2c2ff68a6e85907 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787837.805127:0:15621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a0600/0xe2c2ff68a6e85907 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787837.805861:0:15621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a0400/0xe2c2ff68a6e8590e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787837.805871:0:15621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a0400/0xe2c2ff68a6e8590e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787837.805878:0:15621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a0400/0xe2c2ff68a6e8590e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787837.805889:0:15621:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1785787837.806232:0:15621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1200/0xe2c2ff68a6e85900 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787837.806250:0:15621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1200/0xe2c2ff68a6e85900 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787837.806256:0:15621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1200/0xe2c2ff68a6e85900 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787837.806262:0:15621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413a1200 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787837.806266:0:15621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1200/0xe2c2ff68a6e85900 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787837.806274:0:15621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1200/0xe2c2ff68a6e85900 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787837.806285:0:15621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff919055acd100) 00010000:00010000:2.0:1785787837.806288:0:15621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787837.806293:0:15621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1200/0xe2c2ff68a6e85900 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787837.806299:0:15621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1200/0xe2c2ff68a6e85900 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787837.806311:0:15621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a0600/0xe2c2ff68a6e85907 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787837.806316:0:15621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a0600/0xe2c2ff68a6e85907 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787837.806323:0:15621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a0600/0xe2c2ff68a6e85907 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787837.806328:0:15621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413a0600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787837.806337:0:15621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a0600/0xe2c2ff68a6e85907 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787837.806343:0:15621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a0600/0xe2c2ff68a6e85907 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787837.806351:0:15621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff919047f90a00) 00010000:00010000:2.0:1785787837.806354:0:15621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787837.806356:0:15621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a0600/0xe2c2ff68a6e85907 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787837.806362:0:15621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a0600/0xe2c2ff68a6e85907 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787837.808171:0:15621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a0a00/0xe2c2ff68a6e858f9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7b5 expref: 10 pid: 15621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787837.808190:0:15621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a0400/0xe2c2ff68a6e8590e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7b5 expref: 9 pid: 15621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787837.808197:0:15621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff919047f90e00) 00010000:00010000:2.0:1785787837.808200:0:15621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787837.808203:0:15621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190413a0400, rc 0) 00000100:00100000:2.0:1785787837.808356:0:15621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aabe278a-8cfd-4235-9dd3-056b28921491+9:14435:x1872533744898048:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 3436us (3641us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1785787837.808365:0:15621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 16 00000100:00100000:0.0:1785787837.821204:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787837.821506:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744898176 00000100:00100000:1.0:1785787837.821538:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744898176 00000100:00100000:1.0:1785787837.821600:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 17 00000100:00100000:1.0:1785787837.821610:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aabe278a-8cfd-4235-9dd3-056b28921491+9:14435:x1872533744898176:12345-192.168.203.53@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1785787837.821722:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aabe278a-8cfd-4235-9dd3-056b28921491+9:14435:x1872533744898176:12345-192.168.203.53@tcp:59:lhsmtool_posix.0 Request processed in 114us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787837.821730:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 17 00000100:00100000:1.0:1785787837.835791:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787837.835948:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744898304 00000100:00100000:0.0:1785787837.835957:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744898304 00000100:00100000:0.0:1785787837.836060:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 18 00000100:00100000:0.0:1785787837.836070:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aabe278a-8cfd-4235-9dd3-056b28921491+9:14441:x1872533744898304:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:0.0:1785787837.837168:0:14302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787837.837192:0:14302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e8591c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd7bc expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787837.837271:0:14302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e85923 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787837.837285:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e85923 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787837.837296:0:14302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e85923 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787837.837310:0:14302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f000/0xe2c2ff68a6e8592a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787837.837317:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f000/0xe2c2ff68a6e8592a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787837.837324:0:14302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f000/0xe2c2ff68a6e8592a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787837.837574:0:14302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e85923 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787837.837582:0:14302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e85923 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787837.837589:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e85923 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787837.837595:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919052f5fc00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1785787837.837599:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e85923 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787837.837616:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e85923 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787837.837628:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919047f90100) 00010000:00010000:0.0:1785787837.837631:0:14302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785787837.837635:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e85923 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787837.837641:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e85923 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787837.837652:0:14302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f000/0xe2c2ff68a6e8592a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787837.837658:0:14302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f000/0xe2c2ff68a6e8592a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787837.837664:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f000/0xe2c2ff68a6e8592a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787837.837670:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919052f5f000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1785787837.837673:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f000/0xe2c2ff68a6e8592a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787837.837679:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f000/0xe2c2ff68a6e8592a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787837.837687:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff919059e3e600) 00010000:00010000:0.0:1785787837.837689:0:14302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785787837.837692:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f000/0xe2c2ff68a6e8592a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787837.837707:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f000/0xe2c2ff68a6e8592a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787837.837737:0:14302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e8591c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7bc expref: 10 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787837.837746:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919047f90100) 00010000:00010000:0.0:1785787837.837749:0:14302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785787837.837752:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e8591c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7bc expref: 10 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787837.837762:0:14302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919052f5e400, rc 0) 00000100:00100000:0.0:1785787837.837820:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aabe278a-8cfd-4235-9dd3-056b28921491+9:14441:x1872533744898304:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 1751us (2036us total) trans 0 rc 301/301 00000100:00100000:0.0:1785787837.837858:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 18 00000100:00100000:2.0:1785787837.846883:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787837.846965:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744898432 00000100:00100000:0.0:1785787837.846975:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744898432 00000100:00100000:0.0:1785787837.847023:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 0 00000100:00100000:0.0:1785787837.847033:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:aabe278a-8cfd-4235-9dd3-056b28921491+9:14441:x1872533744898432:12345-192.168.203.53@tcp:700:lfs.0 00000100:00100000:0.0:1785787837.847119:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:aabe278a-8cfd-4235-9dd3-056b28921491+9:14441:x1872533744898432:12345-192.168.203.53@tcp:700:lfs.0 Request processed in 88us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787837.847127:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 0 00000100:00100000:1.0:1785787837.858209:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787837.863533:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744898688 00000100:00100000:0.0:1785787837.864178:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744898688 00000100:00100000:0.0:1785787837.864246:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 19 00000100:00100000:0.0:1785787837.864255:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aabe278a-8cfd-4235-9dd3-056b28921491+9:14441:x1872533744898688:12345-192.168.203.53@tcp:36:lfs.0 00010000:00010000:0.0:1785787837.864365:0:14301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785787837.864399:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1c00/0xe2c2ff68a6e8585f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd737 expref: 9 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787837.864425:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919047f90100) 00010000:00010000:0.0:1785787837.864429:0:14301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785787837.864739:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e85931 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787837.864753:0:14301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e85897 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd799 expref: 5 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787837.864761:0:14301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e85931 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787837.864790:0:14301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e85897 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd799 expref: 5 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787837.864802:0:14301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e85897 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd799 expref: 5 pid: 14303 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787837.864815:0:14301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076eece00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14301:1872533770064640:192.168.203.53@tcp:104: 00000100:00100000:0.0:1785787837.865616:0:14301:0:(client.c:2702:ptlrpc_set_wait()) set ffff91907bdc2540 going to sleep for 11 seconds 00000100:00100000:0.0:1785787837.879399:0:14301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076eece00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14301:1872533770064640:192.168.203.53@tcp:104: 00010000:00010000:0.0:1785787837.879435:0:14301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e85931 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787837.880038:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787837.880122:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744898816 00000100:00100000:2.0:1785787837.880129:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744898816 00010000:00010000:2.0:1785787837.880176:0:14288:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e85897 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd799 expref: 6 pid: 14303 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787837.880227:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 9 00000100:00100000:2.0:1785787837.880236:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+6:2390:x1872533744898816:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785787837.880250:0:14288:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785787837.880257:0:14288:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e85897 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd799 expref: 6 pid: 14303 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787837.880279:0:14288:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e85897 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd799 expref: 6 pid: 14303 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787837.880300:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e85897 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd799 expref: 6 pid: 14303 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787837.880315:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919047f90100) 00010000:00010000:2.0:1785787837.880320:0:14288:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e85931 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787837.880329:0:14288:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e85931 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787837.880337:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e85931 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787837.880368:0:14288:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785787837.880410:0:14301:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e85931 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787837.880418:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e85931 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787837.880439:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e85938 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787837.880449:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e85938 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787837.880456:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e85938 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1785787837.880512:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785787837.880787:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+5:2390:x1872533744898816:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 550us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787837.880795:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 9 00000004:00200000:3.0:1785787837.885768:0:14301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1785787837.885785:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e85931 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787837.885795:0:14301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e85931 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787837.885802:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e85931 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787837.885808:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919052f5e400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787837.885812:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e85931 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787837.885820:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e85931 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787837.886609:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919047f90100) 00010000:00010000:3.0:1785787837.886614:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787837.886619:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e85931 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787837.886626:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e85931 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785787837.886647:0:14301:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008ddee473 reply state 000000009588d468 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e85938 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787837.886656:0:14301:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785787837.886793:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aabe278a-8cfd-4235-9dd3-056b28921491+10:14441:x1872533744898688:12345-192.168.203.53@tcp:36:lfs.0 Request processed in 22535us (28588us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1785787837.886814:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 19 00010000:00010000:2.0:1785787837.907056:0:3320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e85938 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787837.907083:0:3320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e85938 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787837.907105:0:3320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e85938 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787837.907111:0:3320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903c00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787837.907116:0:3320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e85938 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787837.907125:0:3320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e85938 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787837.907139:0:3320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff919055acd400) 00010000:00010000:2.0:1785787837.907143:0:3320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787837.907147:0:3320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e85938 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787837.907154:0:3320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e85938 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785787838.005667:0:14333:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1785787838.071351:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787838.071491:0:15621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744898944 00000100:00100000:2.0:1785787838.071501:0:15621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744898944 00000100:00100000:2.0:1785787838.071576:0:15621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 20 00000100:00100000:2.0:1785787838.071586:0:15621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aabe278a-8cfd-4235-9dd3-056b28921491+9:14449:x1872533744898944:12345-192.168.203.53@tcp:101:lctl.0 00010000:00010000:2.0:1785787838.071608:0:15621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787838.071762:0:15621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1200/0xe2c2ff68a6e8593f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd7c3 expref: -99 pid: 15621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.071866:0:15621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a0600/0xe2c2ff68a6e85946 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.071879:0:15621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a0600/0xe2c2ff68a6e85946 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.071891:0:15621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a0600/0xe2c2ff68a6e85946 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787838.071945:0:15621:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1785787838.071949:0:15621:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1785787838.071982:0:15621:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a0600/0xe2c2ff68a6e85946 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.072004:0:15621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1200/0xe2c2ff68a6e8593f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7c3 expref: 11 pid: 15621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.072021:0:15621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a0600/0xe2c2ff68a6e85946 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7c3 expref: 10 pid: 15621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.072029:0:15621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919047f90a00) 00010000:00010000:2.0:1785787838.072031:0:15621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785787838.072035:0:15621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190413a0600, rc 0) 00000100:00100000:2.0:1785787838.072089:0:15621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aabe278a-8cfd-4235-9dd3-056b28921491+10:14449:x1872533744898944:12345-192.168.203.53@tcp:101:lctl.0 Request processed in 504us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787838.072096:0:15621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 20 00000100:00100000:1.0:1785787838.113964:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787838.114130:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744899072 00000100:00100000:3.0:1785787838.114139:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744899072 00000100:00100000:3.0:1785787838.114201:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 21 00000100:00100000:3.0:1785787838.114210:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+5:14451:x1872533744899072:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:3.0:1785787838.114228:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787838.114255:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903400/0xe2c2ff68a6e8594d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd7ca expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.114319:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e85954 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.114332:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e85954 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.114344:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e85954 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785787838.114417:0:14303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1785787838.114421:0:14303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1785787838.114443:0:14303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e85954 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.114467:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903400/0xe2c2ff68a6e8594d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7ca expref: 7 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.114484:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902600/0xe2c2ff68a6e85954 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7ca expref: 6 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.114511:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919047f90a00) 00010000:00010000:3.0:1785787838.114514:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785787838.114517:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f902600, rc 0) 00000100:00100000:3.0:1785787838.114870:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+6:14451:x1872533744899072:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 619us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787838.114877:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 21 00000100:00100000:1.0:1785787838.131080:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787838.131226:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744899200 00000100:00100000:0.0:1785787838.131235:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744899200 00000100:00100000:0.0:1785787838.131304:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 22 00000100:00100000:0.0:1785787838.131314:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+6:14451:x1872533744899200:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:0.0:1785787838.131334:0:14302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787838.131353:0:14302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f000/0xe2c2ff68a6e8595b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd7d1 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787838.131422:0:14302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e85962 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787838.131435:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e85962 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787838.131445:0:14302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e85962 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787838.131458:0:14302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fa00/0xe2c2ff68a6e85969 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787838.131464:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fa00/0xe2c2ff68a6e85969 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787838.131470:0:14302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fa00/0xe2c2ff68a6e85969 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787838.131606:0:14302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f600/0xe2c2ff68a6e85970 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787838.131615:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f600/0xe2c2ff68a6e85970 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787838.131637:0:14302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f600/0xe2c2ff68a6e85970 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785787838.131674:0:14302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1785787838.131678:0:14302:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1785787838.131703:0:14302:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f600/0xe2c2ff68a6e85970 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787838.131715:0:14302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e85962 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787838.131721:0:14302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e85962 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787838.131727:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e85962 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787838.131733:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919052f5fc00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1785787838.131737:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e85962 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787838.131744:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e85962 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787838.131756:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919047f90a00) 00010000:00010000:0.0:1785787838.131759:0:14302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785787838.131763:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e85962 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787838.131769:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e85962 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787838.131791:0:14302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fa00/0xe2c2ff68a6e85969 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787838.131798:0:14302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fa00/0xe2c2ff68a6e85969 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787838.131804:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fa00/0xe2c2ff68a6e85969 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787838.131809:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919052f5fa00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1785787838.131812:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fa00/0xe2c2ff68a6e85969 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787838.131818:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fa00/0xe2c2ff68a6e85969 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787838.131825:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff919059e3e600) 00010000:00010000:0.0:1785787838.131887:0:14302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785787838.131891:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fa00/0xe2c2ff68a6e85969 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787838.132245:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fa00/0xe2c2ff68a6e85969 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787838.132279:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f000/0xe2c2ff68a6e8595b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7d1 expref: 8 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787838.132293:0:14302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f600/0xe2c2ff68a6e85970 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7d1 expref: 7 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787838.132312:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff919059e3e800) 00010000:00010000:0.0:1785787838.132314:0:14302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1785787838.132317:0:14302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919052f5f600, rc 0) 00000100:00100000:0.0:1785787838.132680:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+7:14451:x1872533744899200:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 1366us (1607us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787838.132687:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 22 00000100:00100000:0.0:1785787838.151789:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787838.154326:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744899456 00000100:00100000:3.0:1785787838.154338:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744899456 00000100:00100000:2.0:1785787838.158430:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 23 00000100:00100000:2.0:1785787838.158444:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+7:14451:x1872533744899456:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:2.0:1785787838.158478:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787838.158500:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1200/0xe2c2ff68a6e85977 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd7d8 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787838.158623:0:14301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1785787838.158735:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1200/0xe2c2ff68a6e85977 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7d8 expref: 9 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.158749:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919047f90a00) 00010000:00010000:2.0:1785787838.158752:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785787838.158756:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1200/0xe2c2ff68a6e85977 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7d8 expref: 9 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.158770:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190413a1200, rc 0) 00000100:00100000:2.0:1785787838.158871:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+8:14451:x1872533744899456:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 430us (7088us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1785787838.158878:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 23 00000100:00100000:1.0:1785787838.166934:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787838.167595:0:15621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744899712 00000100:00100000:3.0:1785787838.167605:0:15621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744899712 00000100:00100000:3.0:1785787838.167697:0:15621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 24 00000100:00100000:3.0:1785787838.167708:0:15621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+8:14451:x1872533744899712:12345-192.168.203.53@tcp:36:lfs.0 00010000:00010000:3.0:1785787838.167759:0:15621:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787838.167786:0:15621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f600/0xe2c2ff68a6e85970 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7d1 expref: 8 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.167803:0:15621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff919059e3e800) 00010000:00010000:3.0:1785787838.167814:0:15621:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785787838.167856:0:15621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903400/0xe2c2ff68a6e85985 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.167868:0:15621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903400/0xe2c2ff68a6e85985 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.167879:0:15621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903400/0xe2c2ff68a6e85985 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785787838.168086:0:15621:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f9f47fac reply state 000000002ce6e34c transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903400/0xe2c2ff68a6e85985 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787838.168107:0:15621:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1785787838.168133:0:15621:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:3.0:1785787838.168217:0:15621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+9:14451:x1872533744899712:12345-192.168.203.53@tcp:36:lfs.0 Request processed in 511us (1290us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1785787838.168223:0:15621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 24 00000100:00100000:1.0:1785787838.176683:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00010000:00010000:2.0:1785787838.176969:0:3319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903400/0xe2c2ff68a6e85985 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.176981:0:3319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903400/0xe2c2ff68a6e85985 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.176988:0:3319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903400/0xe2c2ff68a6e85985 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.176994:0:3319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787838.176998:0:3319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903400/0xe2c2ff68a6e85985 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.177016:0:3319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903400/0xe2c2ff68a6e85985 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.177031:0:3319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff919055acdc00) 00010000:00010000:2.0:1785787838.177034:0:3319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1785787838.177038:0:3319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903400/0xe2c2ff68a6e85985 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.177044:0:3319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903400/0xe2c2ff68a6e85985 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787838.177441:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744899968 00000100:00100000:3.0:1785787838.177450:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744899968 00000100:00100000:3.0:1785787838.177504:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2 00000100:00100000:3.0:1785787838.177514:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+8:14451:x1872533744899968:12345-192.168.203.53@tcp:35:lfs.0 00000100:00100000:3.0:1785787838.177773:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+9:14451:x1872533744899968:12345-192.168.203.53@tcp:35:lfs.0 Request processed in 260us (1098us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1785787838.177780:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2 00000100:00100000:1.0:1785787838.184032:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787838.184124:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744900224 00000100:00100000:3.0:1785787838.184133:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744900224 00000100:00100000:3.0:1785787838.184183:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 25 00000100:00100000:3.0:1785787838.184205:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+9:14451:x1872533744900224:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:3.0:1785787838.184229:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787838.184257:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e8598c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd7df expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.184325:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902e00/0xe2c2ff68a6e85993 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.184339:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902e00/0xe2c2ff68a6e85993 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.184351:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902e00/0xe2c2ff68a6e85993 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.184390:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e8599a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.184398:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e8599a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.184405:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e8599a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785787838.184522:0:14303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1785787838.184881:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902e00/0xe2c2ff68a6e85993 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.184890:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902e00/0xe2c2ff68a6e85993 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.184940:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902e00/0xe2c2ff68a6e85993 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.184947:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f902e00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787838.184952:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902e00/0xe2c2ff68a6e85993 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.184959:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902e00/0xe2c2ff68a6e85993 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.184970:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919047f90a00) 00010000:00010000:3.0:1785787838.184974:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787838.184978:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902e00/0xe2c2ff68a6e85993 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.184995:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902e00/0xe2c2ff68a6e85993 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.185009:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e8599a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.185015:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e8599a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.185020:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e8599a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.185025:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903c00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787838.185028:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e8599a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.185034:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e8599a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.185041:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff919055acd500) 00010000:00010000:3.0:1785787838.185043:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787838.185046:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e8599a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.185051:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e8599a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.185087:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e8598c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7df expref: 11 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.185339:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919047f90a00) 00010000:00010000:3.0:1785787838.185342:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785787838.185347:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e8598c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7df expref: 11 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.185357:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f903000, rc 0) 00000100:00100000:3.0:1785787838.185425:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+10:14451:x1872533744900224:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 1234us (1402us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1785787838.185433:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 25 00000100:00100000:1.0:1785787838.196485:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787838.196942:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744900352 00000100:00100000:2.0:1785787838.196954:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744900352 00000100:00100000:2.0:1785787838.197013:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 26 00000100:00100000:2.0:1785787838.197022:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b6ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+10:14451:x1872533744900352:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:2.0:1785787838.197044:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787838.197065:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1200/0xe2c2ff68a6e859a8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd7e6 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.197154:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1c00/0xe2c2ff68a6e859af lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.197168:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1c00/0xe2c2ff68a6e859af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.197178:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1c00/0xe2c2ff68a6e859af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787838.197223:0:14301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1785787838.197227:0:14301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785787838.197276:0:14301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1c00/0xe2c2ff68a6e859af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.197299:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1200/0xe2c2ff68a6e859a8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7e6 expref: 12 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.197315:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1c00/0xe2c2ff68a6e859af lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7e6 expref: 11 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.197323:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff919047f90900) 00010000:00010000:2.0:1785787838.197325:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785787838.197328:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190413a1c00, rc 0) 00000100:00100000:2.0:1785787838.197390:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b6ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+11:14451:x1872533744900352:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 369us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787838.197396:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 26 00000100:00100000:1.0:1785787838.217157:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787838.217494:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744900480 00000100:00100000:3.0:1785787838.217504:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744900480 00000100:00100000:3.0:1785787838.217558:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 3 00000100:00100000:3.0:1785787838.217567:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b6c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+11:14451:x1872533744900480:12345-192.168.203.53@tcp:37:lfs.0 00000100:00100000:0.0:1785787838.228609:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b6c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+11:14451:x1872533744900480:12345-192.168.203.53@tcp:37:lfs.0 Request processed in 11033us (11450us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787838.228623:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 3 00000100:00100000:2.0:1785787838.246009:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787838.246093:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744900736 00000100:00100000:0.0:1785787838.246103:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744900736 00000100:00100000:0.0:1785787838.246318:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 4 00000100:00100000:0.0:1785787838.246329:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905fac1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+11:14451:x1872533744900736:12345-192.168.203.53@tcp:35:lfs.0 00000100:00100000:0.0:1785787838.247883:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905fac1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+12:14451:x1872533744900736:12345-192.168.203.53@tcp:35:lfs.0 Request processed in 1552us (1879us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1785787838.247901:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 4 00000100:00100000:1.0:1785787838.315997:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787838.316135:0:15621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744900864 00000100:00100000:2.0:1785787838.316146:0:15621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744900864 00000100:00100000:2.0:1785787838.316200:0:15621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 27 00000100:00100000:2.0:1785787838.316209:0:15621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b6cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aabe278a-8cfd-4235-9dd3-056b28921491+10:14457:x1872533744900864:12345-192.168.203.53@tcp:101:bash.0 00010000:00010000:2.0:1785787838.316227:0:15621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787838.316257:0:15621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1200/0xe2c2ff68a6e859b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd7ed expref: -99 pid: 15621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.316312:0:15621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a0a00/0xe2c2ff68a6e859bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.316325:0:15621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a0a00/0xe2c2ff68a6e859bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.316353:0:15621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a0a00/0xe2c2ff68a6e859bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.316368:0:15621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677de00/0xe2c2ff68a6e859c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.316518:0:15621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677de00/0xe2c2ff68a6e859c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.316527:0:15621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677de00/0xe2c2ff68a6e859c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.316622:0:15621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d400/0xe2c2ff68a6e859cb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.316630:0:15621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d400/0xe2c2ff68a6e859cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.316637:0:15621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d400/0xe2c2ff68a6e859cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787838.316669:0:15621:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1785787838.316673:0:15621:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785787838.316709:0:15621:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d400/0xe2c2ff68a6e859cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.316721:0:15621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a0a00/0xe2c2ff68a6e859bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.316728:0:15621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a0a00/0xe2c2ff68a6e859bd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.316744:0:15621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a0a00/0xe2c2ff68a6e859bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.316751:0:15621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190413a0a00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787838.316754:0:15621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a0a00/0xe2c2ff68a6e859bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.316762:0:15621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a0a00/0xe2c2ff68a6e859bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.316772:0:15621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919047f90a00) 00010000:00010000:2.0:1785787838.316775:0:15621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787838.316789:0:15621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a0a00/0xe2c2ff68a6e859bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.316796:0:15621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a0a00/0xe2c2ff68a6e859bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.316810:0:15621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677de00/0xe2c2ff68a6e859c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.316817:0:15621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677de00/0xe2c2ff68a6e859c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.316823:0:15621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677de00/0xe2c2ff68a6e859c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.316915:0:15621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677de00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787838.316917:0:15621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677de00/0xe2c2ff68a6e859c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.316935:0:15621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677de00/0xe2c2ff68a6e859c4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.316943:0:15621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff919047f90f00) 00010000:00010000:2.0:1785787838.316946:0:15621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787838.316949:0:15621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677de00/0xe2c2ff68a6e859c4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.316956:0:15621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677de00/0xe2c2ff68a6e859c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.316986:0:15621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1200/0xe2c2ff68a6e859b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7ed expref: 12 pid: 15621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.316999:0:15621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d400/0xe2c2ff68a6e859cb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7ed expref: 11 pid: 15621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.317007:0:15621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff919047f90900) 00010000:00010000:2.0:1785787838.317009:0:15621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1785787838.317012:0:15621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677d400, rc 0) 00000100:00100000:2.0:1785787838.317061:0:15621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b6cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aabe278a-8cfd-4235-9dd3-056b28921491+11:14457:x1872533744900864:12345-192.168.203.53@tcp:101:bash.0 Request processed in 854us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787838.317068:0:15621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 27 00000100:00100000:0.0:1785787838.320027:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787838.320089:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744901120 00000100:00100000:2.0:1785787838.320097:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744901120 00000100:00100000:2.0:1785787838.320145:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 28 00000100:00100000:2.0:1785787838.320153:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aabe278a-8cfd-4235-9dd3-056b28921491+11:14457:x1872533744901120:12345-192.168.203.53@tcp:101:bash.0 00010000:00010000:2.0:1785787838.320182:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787838.320198:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c400/0xe2c2ff68a6e859d2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd7f4 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.320301:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e859d9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.320315:0:14301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1c00/0xe2c2ff68a6e859af lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7e6 expref: 11 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.320323:0:14301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e859d9 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.320353:0:14301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1c00/0xe2c2ff68a6e859af lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7e6 expref: 11 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.320367:0:14301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1c00/0xe2c2ff68a6e859af lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7e6 expref: 11 pid: 14301 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787838.320389:0:14301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14301:1872533770064768:192.168.203.53@tcp:104: 00000100:00100000:2.0:1785787838.320463:0:14301:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190507ea3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785787838.322899:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787838.322979:0:14287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744901248 00000100:00100000:1.0:1785787838.322985:0:14287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744901248 00010000:00010000:1.0:1785787838.323015:0:14287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1c00/0xe2c2ff68a6e859af lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7e6 expref: 12 pid: 14301 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787838.323048:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 10 00000100:00100000:1.0:1785787838.323056:0:14287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+12:2390:x1872533744901248:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785787838.323068:0:14287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785787838.323074:0:14287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1c00/0xe2c2ff68a6e859af lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7e6 expref: 12 pid: 14301 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787838.323096:0:14287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1c00/0xe2c2ff68a6e859af lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7e6 expref: 12 pid: 14301 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787838.323125:0:14287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff919047f90900) 00010000:00010000:1.0:1785787838.323130:0:14287:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e859d9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787838.323139:0:14287:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e859d9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787838.323146:0:14287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e859d9 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787838.323161:0:14287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785787838.323197:0:14287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+12:2390:x1872533744901248:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 142us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787838.323205:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 10 00010000:00010000:2.0:1785787838.323348:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190413a1c00/0xe2c2ff68a6e859af lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7e6 expref: 11 pid: 14301 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787838.323364:0:14301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14301:1872533770064768:192.168.203.53@tcp:104: 00010000:00010000:2.0:1785787838.323391:0:14301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e859d9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.323409:0:14301:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e859d9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.323413:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e859d9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.323430:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e859e0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.323438:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e859e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.323444:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e859e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.324088:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e859e7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.324098:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e859e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.324105:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e859e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787838.324126:0:14301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1785787838.324151:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e859d9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.324158:0:14301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e859d9 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.324164:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e859d9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.324176:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677cc00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787838.324180:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e859d9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.324188:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e859d9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.324197:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff919047f90900) 00010000:00010000:2.0:1785787838.324199:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787838.324203:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e859d9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.324208:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e859d9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785787838.324217:0:14301:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003a128e72 reply state 000000007dabd244 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e859e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787838.324224:0:14301:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785787838.324253:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c400/0xe2c2ff68a6e859d2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7f4 expref: 14 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.324265:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e859e7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7f4 expref: 13 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.324272:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919047f90300) 00010000:00010000:2.0:1785787838.324274:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1785787838.324276:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677d000, rc 0) 00000100:00100000:2.0:1785787838.324308:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aabe278a-8cfd-4235-9dd3-056b28921491+14:14457:x1872533744901120:12345-192.168.203.53@tcp:101:bash.0 Request processed in 4155us (4286us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1785787838.324322:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 28 00010000:00010000:2.0:1785787838.326508:0:3320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e859e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.326521:0:3320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e859e0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.326527:0:3320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e859e0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.326533:0:3320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677ce00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787838.326536:0:3320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e859e0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.326543:0:3320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e859e0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.326554:0:3320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff919047f90c00) 00010000:00010000:2.0:1785787838.326557:0:3320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787838.326560:0:3320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e859e0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.326566:0:3320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e859e0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787838.336081:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787838.336370:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744901376 00000100:00100000:3.0:1785787838.336389:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744901376 00000100:00100000:3.0:1785787838.336440:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 29 00000100:00100000:3.0:1785787838.336449:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aabe278a-8cfd-4235-9dd3-056b28921491+13:14457:x1872533744901376:12345-192.168.203.53@tcp:101:bash.0 00010000:00010000:3.0:1785787838.336471:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787838.336489:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e859f5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd7fb expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.336544:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e859fc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.336556:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e859fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.336582:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e859fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785787838.336618:0:14303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1785787838.336622:0:14303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1785787838.336639:0:14303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e859fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.336649:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e859fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.336669:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e859f5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7fb expref: 15 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.336683:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e859fc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7fb expref: 14 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.336691:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919047f90300) 00010000:00010000:3.0:1785787838.336694:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785787838.336697:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f903c00, rc 0) 00000100:00100000:3.0:1785787838.336750:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aabe278a-8cfd-4235-9dd3-056b28921491+14:14457:x1872533744901376:12345-192.168.203.53@tcp:101:bash.0 Request processed in 301us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787838.336757:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 29 00000100:00100000:1.0:1785787838.340752:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787838.340968:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744901632 00000100:00100000:2.0:1785787838.340977:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744901632 00000100:00100000:2.0:1785787838.341022:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 5 00000100:00100000:2.0:1785787838.341031:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b6cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aabe278a-8cfd-4235-9dd3-056b28921491+14:14457:x1872533744901632:12345-192.168.203.53@tcp:35:bash.0 00000100:00100000:2.0:1785787838.341322:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b6cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aabe278a-8cfd-4235-9dd3-056b28921491+15:14457:x1872533744901632:12345-192.168.203.53@tcp:35:bash.0 Request processed in 291us (576us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1785787838.341341:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 5 00000100:00100000:0.0:1785787838.418478:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787838.418587:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744901888 00000100:00100000:2.0:1785787838.418596:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744901888 00000100:00100000:2.0:1785787838.418646:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 30 00000100:00100000:2.0:1785787838.418655:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919076eec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aabe278a-8cfd-4235-9dd3-056b28921491+15:14467:x1872533744901888:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:2.0:1785787838.418677:0:14302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787838.418694:0:14302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85a03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd802 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787838.418808:0:14302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1785787838.418948:0:14302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85a03 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd802 expref: 17 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.418962:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919047f90a00) 00010000:00010000:2.0:1785787838.418965:0:14302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785787838.418970:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85a03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd802 expref: 17 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.418983:0:14302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677ce00, rc 0) 00000100:00100000:2.0:1785787838.419028:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919076eec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aabe278a-8cfd-4235-9dd3-056b28921491+16:14467:x1872533744901888:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 375us (559us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1785787838.419035:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 30 00000100:00100000:1.0:1785787838.421313:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787838.421411:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744902144 00000100:00100000:2.0:1785787838.421419:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744902144 00000100:00100000:2.0:1785787838.421458:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 6 00000100:00100000:2.0:1785787838.421467:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b6c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aabe278a-8cfd-4235-9dd3-056b28921491+16:14467:x1872533744902144:12345-192.168.203.53@tcp:35:lfs.0 00000100:00100000:2.0:1785787838.421761:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b6c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aabe278a-8cfd-4235-9dd3-056b28921491+17:14467:x1872533744902144:12345-192.168.203.53@tcp:35:lfs.0 Request processed in 294us (450us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1785787838.421769:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 6 00000100:00100000:1.0:1785787838.450023:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787838.450221:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744902400 00000100:00100000:3.0:1785787838.450230:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744902400 00000100:00100000:3.0:1785787838.450291:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 31 00000100:00100000:3.0:1785787838.450300:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b6c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aabe278a-8cfd-4235-9dd3-056b28921491+17:14470:x1872533744902400:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:3.0:1785787838.450322:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787838.450357:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e85a11 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd809 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.450460:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902e00/0xe2c2ff68a6e85a18 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.450475:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902e00/0xe2c2ff68a6e85a18 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.450488:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902e00/0xe2c2ff68a6e85a18 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785787838.450499:0:14303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1785787838.450627:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e85a11 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd809 expref: 20 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.450644:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902e00/0xe2c2ff68a6e85a18 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd809 expref: 19 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787838.450651:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919047f90300) 00010000:00010000:3.0:1785787838.450654:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785787838.450658:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f902e00, rc 0) 00000100:00100000:3.0:1785787838.450714:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b6c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aabe278a-8cfd-4235-9dd3-056b28921491+19:14470:x1872533744902400:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 415us (699us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1785787838.450720:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 31 00010000:00010000:3.0:1785787838.451316:0:15809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785787838.454556:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787838.454601:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787838.454684:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744902656 00000100:00100000:0.0:1785787838.454693:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744902656 00000100:00100000:0.0:1785787838.454744:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 32 00000100:00100000:0.0:1785787838.454752:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b6cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aabe278a-8cfd-4235-9dd3-056b28921491+19:14470:x1872533744902656:12345-192.168.203.53@tcp:54:lfs.0 00010000:00010000:0.0:1785787838.454862:0:14302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e85a26 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787838.454877:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e85a26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787838.454888:0:14302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e85a26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787838.454911:0:14302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e85a26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787838.454918:0:14302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e85a26 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787838.454925:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e85a26 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787838.454932:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919052f5ee00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1785787838.454936:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e85a26 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787838.454943:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e85a26 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787838.454953:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919047f90300) 00010000:00010000:0.0:1785787838.454956:0:14302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1785787838.454959:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e85a26 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787838.454964:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e85a26 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787838.455037:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b6cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aabe278a-8cfd-4235-9dd3-056b28921491+19:14470:x1872533744902656:12345-192.168.203.53@tcp:54:lfs.0 Request processed in 285us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787838.455045:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 32 00000100:00100000:2.0:1785787838.455303:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744902528 00000100:00100000:2.0:1785787838.455308:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744902528 00000100:00100000:2.0:1785787838.455346:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 0 00000100:00100000:2.0:1785787838.455354:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b6c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aabe278a-8cfd-4235-9dd3-056b28921491+19:2391:x1872533744902528:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785787838.455364:0:14288:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785787838.455392:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902e00/0xe2c2ff68a6e85a18 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd809 expref: 19 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.455404:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919047f90300) 00010000:00010000:2.0:1785787838.455408:0:14288:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785787838.455441:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b6c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aabe278a-8cfd-4235-9dd3-056b28921491+18:2391:x1872533744902528:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 88us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787838.455448:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 0 00000100:00100000:1.0:1785787838.458471:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787838.458532:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744902912 00000100:00100000:0.0:1785787838.458538:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744902912 00000100:00100000:0.0:1785787838.458584:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 7 00000100:00100000:0.0:1785787838.458593:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b6cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aabe278a-8cfd-4235-9dd3-056b28921491+18:14470:x1872533744902912:12345-192.168.203.53@tcp:35:lfs.0 00000100:00100000:0.0:1785787838.459005:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b6cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aabe278a-8cfd-4235-9dd3-056b28921491+19:14470:x1872533744902912:12345-192.168.203.53@tcp:35:lfs.0 Request processed in 411us (537us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1785787838.459012:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 7 00000100:00100000:3.0:1785787838.727238:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787838.727354:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744903168 00000100:00100000:1.0:1785787838.727364:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744903168 00000100:00100000:1.0:1785787838.727432:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 33 00000100:00100000:1.0:1785787838.727442:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aabe278a-8cfd-4235-9dd3-056b28921491+19:14501:x1872533744903168:12345-192.168.203.53@tcp:101:cat.0 00010000:00010000:1.0:1785787838.727481:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787838.727504:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4c00/0xe2c2ff68a6e85a2d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd810 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787838.727616:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4600/0xe2c2ff68a6e85a34 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787838.727631:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4600/0xe2c2ff68a6e85a34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787838.727642:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4600/0xe2c2ff68a6e85a34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785787838.727653:0:14303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1785787838.727785:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4c00/0xe2c2ff68a6e85a2d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd810 expref: 22 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787838.727804:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4600/0xe2c2ff68a6e85a34 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd810 expref: 21 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787838.727813:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919047f90300) 00010000:00010000:1.0:1785787838.727816:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785787838.727819:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190443c4600, rc 0) 00000100:00100000:1.0:1785787838.727917:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aabe278a-8cfd-4235-9dd3-056b28921491+21:14501:x1872533744903168:12345-192.168.203.53@tcp:101:cat.0 Request processed in 476us (689us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1785787838.727924:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 33 00000100:00100000:3.0:1785787838.735707:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787838.735794:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744903424 00000100:00100000:0.0:1785787838.735804:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744903424 00000100:00100000:0.0:1785787838.735883:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 8 00000100:00100000:0.0:1785787838.735893:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aabe278a-8cfd-4235-9dd3-056b28921491+21:14501:x1872533744903424:12345-192.168.203.53@tcp:35:cat.0 00000100:00100000:0.0:1785787838.736195:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aabe278a-8cfd-4235-9dd3-056b28921491+22:14501:x1872533744903424:12345-192.168.203.53@tcp:35:cat.0 Request processed in 302us (494us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1785787838.736204:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 8 00000100:00100000:3.0:1785787838.741200:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787838.741330:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744903552 00000100:00100000:0.0:1785787838.741339:0:14286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744903552 00000100:00100000:0.0:1785787838.741406:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 1 00000100:00100000:0.0:1785787838.741415:0:14286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aabe278a-8cfd-4235-9dd3-056b28921491+22:2390:x1872533744903552:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785787838.741429:0:14286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785787838.741451:0:14286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4600/0xe2c2ff68a6e85a34 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd810 expref: 22 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787838.741486:0:14286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919047f90300) 00010000:00010000:0.0:1785787838.741490:0:14286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785787838.741539:0:14286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aabe278a-8cfd-4235-9dd3-056b28921491+21:2390:x1872533744903552:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 125us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787838.741547:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 1 00000100:00100000:3.0:1785787838.848881:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787838.849351:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744903808 00000100:00100000:0.0:1785787838.849363:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744903808 00000100:00100000:0.0:1785787838.849445:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 34 00000100:00100000:0.0:1785787838.849457:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aabe278a-8cfd-4235-9dd3-056b28921491+21:14507:x1872533744903808:12345-192.168.203.53@tcp:101:dd.0 00010000:00010000:0.0:1785787838.849491:0:14302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787838.849519:0:14302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e85a42 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd817 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787838.849645:0:14302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e85a49 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787838.849662:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e85a49 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787838.849678:0:14302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e85a49 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785787838.849693:0:14302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1785787838.849908:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e85a42 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd817 expref: 24 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787838.849930:0:14302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e85a49 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd817 expref: 23 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787838.849949:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919047f90300) 00010000:00010000:0.0:1785787838.849952:0:14302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785787838.849956:0:14302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919052f5fc00, rc 0) 00000100:00100000:0.0:1785787838.850028:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aabe278a-8cfd-4235-9dd3-056b28921491+23:14507:x1872533744903808:12345-192.168.203.53@tcp:101:dd.0 Request processed in 573us (1208us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1785787838.850036:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 34 00000100:00100000:3.0:1785787838.855823:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787838.855949:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744904064 00000100:00100000:1.0:1785787838.855961:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744904064 00000100:00100000:1.0:1785787838.856030:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 35 00000100:00100000:1.0:1785787838.856059:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aabe278a-8cfd-4235-9dd3-056b28921491+23:14507:x1872533744904064:12345-192.168.203.53@tcp:36:dd.0 00010000:00010000:1.0:1785787838.856134:0:14303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1785787838.856167:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fc00/0xe2c2ff68a6e85a49 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd817 expref: 23 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787838.856191:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903c00/0xe2c2ff68a6e859fc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7fb expref: 22 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787838.856203:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919047f90300) 00010000:00010000:1.0:1785787838.856208:0:14303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785787838.856492:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4c00/0xe2c2ff68a6e85a57 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787838.856509:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4c00/0xe2c2ff68a6e85a57 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787838.856520:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4c00/0xe2c2ff68a6e85a57 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785787838.856583:0:14303:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1785787838.856612:0:14303:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d9d7497b reply state 00000000c543aec1 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4c00/0xe2c2ff68a6e85a57 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787838.856622:0:14303:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785787838.856732:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aabe278a-8cfd-4235-9dd3-056b28921491+24:14507:x1872533744904064:12345-192.168.203.53@tcp:36:dd.0 Request processed in 676us (919us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1785787838.856740:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 35 00000020:00080000:1.0:1785787838.856745:0:14303:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1785787838.860606:0:3319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4c00/0xe2c2ff68a6e85a57 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.860624:0:3319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4c00/0xe2c2ff68a6e85a57 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.860633:0:3319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4c00/0xe2c2ff68a6e85a57 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.860640:0:3319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190443c4c00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787838.860645:0:3319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4c00/0xe2c2ff68a6e85a57 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.860673:0:3319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4c00/0xe2c2ff68a6e85a57 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.860691:0:3319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919047f90300) 00010000:00010000:2.0:1785787838.860695:0:3319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787838.860700:0:3319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4c00/0xe2c2ff68a6e85a57 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787838.860707:0:3319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4c00/0xe2c2ff68a6e85a57 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787838.899858:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b6caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770064896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785787838.899954:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787838.900097:0:14941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770064896 00000100:00100000:1.0:1785787838.900109:0:14941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770064896 00000100:00100000:1.0:1785787838.900204:0:14941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1785787838.900216:0:14941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533770064896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785787838.900260:0:14941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785787838.900314:0:14941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3335:x1872533770064896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787838.900322:0:14941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1785787838.900497:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785787838.900539:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b6caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3335:1872533770064896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785787838.900780:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533770065280:0@lo:400:kworker.0 00000100:00100000:0.0:1785787838.900817:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787838.900866:0:3334:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785787838.900872:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076eec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770065152:0@lo:400:kworker.0 00000100:00100000:0.0:1785787838.900898:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787838.900930:0:14937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770065152 00000100:00100000:0.0:1785787838.900934:0:14937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770065152 00000100:00100000:0.0:1785787838.900975:0:14937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1785787838.900983:0:14937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770065152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787838.901022:0:14937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770065152:12345-0@lo:400:kworker.0 Request processed in 40us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787838.901028:0:14937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1785787838.901044:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785787838.901061:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076eec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770065152:0@lo:400:kworker.0 00000100:00100000:0.0:1785787838.901080:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907fd91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533770065408:0@lo:400:kworker.0 00000100:00100000:0.0:1785787838.901102:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787838.901119:0:3335:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1785787838.901125:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919076eec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9a1da20-2955-44fa-b075-f73628199db8:3335:1872533770065024:0@lo:400:kworker.0 00000100:00100000:0.0:1785787838.901164:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787838.901186:0:3335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b48e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3335:1872533770065536:0@lo:400:kworker.0 00000100:00100000:0.0:1785787838.901208:0:3335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785787838.901231:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770065280 00000100:00100000:0.0:1785787838.901235:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770065280 00000100:00100000:0.0:1785787838.901258:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770065408 00000100:00100000:0.0:1785787838.901261:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770065408 00000100:00080000:0.0:1785787838.901275:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785787838.901286:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770065536 00000100:00100000:0.0:1785787838.901289:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770065536 00000100:00080000:0.0:1785787838.901299:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785787838.901312:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1785787838.901318:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533770065280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787838.901377:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3334:x1872533770065280:12345-0@lo:400:kworker.0 Request processed in 50us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787838.901384:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1785787838.901408:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3334:1872533770065280:0@lo:400:kworker.0 00000100:00100000:0.0:1785787838.901425:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1785787838.901432:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533770065408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787838.901463:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3335:x1872533770065408:12345-0@lo:400:kworker.0 Request processed in 31us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787838.901469:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1785787838.901488:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907fd91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3335:1872533770065408:0@lo:400:kworker.0 00000100:00100000:0.0:1785787838.901504:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1785787838.901510:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3335:x1872533770065536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785787838.901541:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3335:x1872533770065536:12345-0@lo:400:kworker.0 Request processed in 32us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787838.901554:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1785787838.901575:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b48e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3335:1872533770065536:0@lo:400:kworker.0 00000100:00100000:1.0:1785787838.902037:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770065024 00000100:00100000:1.0:1785787838.902042:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770065024 00000100:00100000:1.0:1785787838.902071:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1785787838.902078:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905fafb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+19:3335:x1872533770065024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787838.902119:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905fafb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9a1da20-2955-44fa-b075-f73628199db8+19:3335:x1872533770065024:12345-0@lo:400:kworker.0 Request processed in 42us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787838.902126:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1785787838.902167:0:3335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919076eec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9a1da20-2955-44fa-b075-f73628199db8:3335:1872533770065024:0@lo:400:kworker.0 00000100:00100000:3.0:1785787838.902214:0:3334:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785787838.902243:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b6c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770065664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785787838.902313:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787838.902942:0:14940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770065664 00000100:00100000:1.0:1785787838.902949:0:14940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770065664 00000100:00100000:1.0:1785787838.902992:0:14940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1785787838.903001:0:14940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770065664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785787838.903032:0:14940:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785787838.903102:0:14940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3334:x1872533770065664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787838.903109:0:14940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1785787838.904492:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b6c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770065664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785787838.978022:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787838.978128:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744904320 00000100:00100000:0.0:1785787838.978138:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744904320 00000100:00100000:0.0:1785787838.978193:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 9 00000100:00100000:0.0:1785787838.978202:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aabe278a-8cfd-4235-9dd3-056b28921491+23:14507:x1872533744904320:12345-192.168.203.53@tcp:35:dd.0 00000100:00100000:0.0:1785787838.978458:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aabe278a-8cfd-4235-9dd3-056b28921491+24:14507:x1872533744904320:12345-192.168.203.53@tcp:35:dd.0 Request processed in 255us (442us total) trans 8589934611 rc 0/0 00000100:00100000:0.0:1785787838.978466:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 9 00000100:00100000:3.0:1785787839.102748:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787839.102784:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787839.102811:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787839.102867:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787839.102999:0:14937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744904704 00000100:00100000:1.0:1785787839.103008:0:14937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744904704 00000100:00100000:1.0:1785787839.103055:0:14937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744904960 00000100:00100000:1.0:1785787839.103057:0:14937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744904960 00000100:00100000:1.0:1785787839.103072:0:14937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744904576 00000100:00100000:1.0:1785787839.103080:0:14937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744904576 00000100:00100000:1.0:1785787839.103099:0:14937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 16 00000100:00100000:1.0:1785787839.103116:0:14937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aabe278a-8cfd-4235-9dd3-056b28921491+5:2391:x1872533744904704:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1785787839.103194:0:14937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aabe278a-8cfd-4235-9dd3-056b28921491+5:2391:x1872533744904704:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 86us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787839.103201:0:14937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 16 00000100:00100000:1.0:1785787839.103218:0:14937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 17 00000100:00100000:1.0:1785787839.103224:0:14937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+5:2391:x1872533744904960:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1785787839.103258:0:14937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+5:2391:x1872533744904960:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 35us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787839.103264:0:14937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 17 00000100:00100000:1.0:1785787839.103274:0:14937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 18 00000100:00100000:1.0:1785787839.103280:0:14937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aabe278a-8cfd-4235-9dd3-056b28921491+5:2391:x1872533744904576:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1785787839.103300:0:14937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aabe278a-8cfd-4235-9dd3-056b28921491+5:2391:x1872533744904576:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 20us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787839.103305:0:14937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 18 00000100:00080000:1.0:1785787839.103320:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785787839.103324:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785787839.103534:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787839.103595:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787839.103651:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744904832 00000100:00100000:2.0:1785787839.103655:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744904832 00000100:00100000:2.0:1785787839.103695:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 33 00000100:00100000:2.0:1785787839.103701:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+11:2391:x1872533744904832:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:2.0:1785787839.103731:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+11:2391:x1872533744904832:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 30us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787839.103748:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 33 00000100:00080000:3.0:1785787839.103844:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785787839.103897:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744904448 00000100:00100000:0.0:1785787839.103902:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744904448 00000100:00100000:0.0:1785787839.103936:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 124 00000100:00100000:0.0:1785787839.103943:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+13:2391:x1872533744904448:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1785787839.103978:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+13:2391:x1872533744904448:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 36us (1249us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787839.103985:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 124 00000100:00100000:1.0:1785787839.104137:0:14937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744905088 00000100:00100000:1.0:1785787839.104141:0:14937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744905088 00000100:00100000:1.0:1785787839.104180:0:14937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 19 00000100:00100000:1.0:1785787839.104186:0:14937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+5:2391:x1872533744905088:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1785787839.104212:0:14937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+5:2391:x1872533744905088:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 26us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787839.104217:0:14937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 19 00000100:00080000:3.0:1785787839.105097:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785787839.343456:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787839.343626:0:15621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744905216 00000100:00100000:2.0:1785787839.343636:0:15621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744905216 00000100:00100000:2.0:1785787839.343704:0:15621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 36 00000100:00100000:2.0:1785787839.343714:0:15621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aabe278a-8cfd-4235-9dd3-056b28921491+24:14521:x1872533744905216:12345-192.168.203.53@tcp:101:stat.0 00010000:00010000:2.0:1785787839.343737:0:15621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787839.343767:0:15621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85a5e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd81e expref: -99 pid: 15621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.343882:0:15621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c400/0xe2c2ff68a6e85a65 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.343897:0:15621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c400/0xe2c2ff68a6e85a65 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.343907:0:15621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c400/0xe2c2ff68a6e85a65 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.343921:0:15621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85a6c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.343928:0:15621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85a6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.343935:0:15621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85a6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.344017:0:15621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677de00/0xe2c2ff68a6e85a73 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.344026:0:15621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677de00/0xe2c2ff68a6e85a73 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.344032:0:15621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677de00/0xe2c2ff68a6e85a73 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787839.344066:0:15621:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1785787839.344070:0:15621:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785787839.344101:0:15621:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91904677de00/0xe2c2ff68a6e85a73 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.344132:0:15621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677de00/0xe2c2ff68a6e85a73 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.344141:0:15621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c400/0xe2c2ff68a6e85a65 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.344148:0:15621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c400/0xe2c2ff68a6e85a65 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.344154:0:15621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c400/0xe2c2ff68a6e85a65 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.344160:0:15621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677c400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787839.344164:0:15621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c400/0xe2c2ff68a6e85a65 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.344172:0:15621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c400/0xe2c2ff68a6e85a65 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.344184:0:15621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff919047f90900) 00010000:00010000:2.0:1785787839.344187:0:15621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787839.344192:0:15621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c400/0xe2c2ff68a6e85a65 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.344198:0:15621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c400/0xe2c2ff68a6e85a65 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.344209:0:15621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85a6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.344215:0:15621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85a6c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.344225:0:15621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85a6c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.344447:0:15621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677cc00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787839.344450:0:15621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85a6c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.344457:0:15621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85a6c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.344465:0:15621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff919047f90c00) 00010000:00010000:2.0:1785787839.344468:0:15621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787839.344470:0:15621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85a6c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.344476:0:15621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85a6c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.344504:0:15621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85a5e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd81e expref: 26 pid: 15621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.344515:0:15621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677de00/0xe2c2ff68a6e85a73 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd81e expref: 25 pid: 15621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.344522:0:15621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919047f90300) 00010000:00010000:2.0:1785787839.344525:0:15621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785787839.344527:0:15621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677de00, rc 0) 00000100:00100000:2.0:1785787839.344620:0:15621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aabe278a-8cfd-4235-9dd3-056b28921491+25:14521:x1872533744905216:12345-192.168.203.53@tcp:101:stat.0 Request processed in 907us (1172us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787839.344636:0:15621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 36 00000100:00080000:3.0:1785787839.346408:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785787839.461610:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787839.461683:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744905472 00000100:00100000:2.0:1785787839.461693:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744905472 00000100:00100000:2.0:1785787839.461751:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 37 00000100:00100000:2.0:1785787839.461761:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b6c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aabe278a-8cfd-4235-9dd3-056b28921491+25:14527:x1872533744905472:12345-192.168.203.53@tcp:36:truncate.0 00010000:00010000:2.0:1785787839.461812:0:14302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785787839.461873:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677de00/0xe2c2ff68a6e85a73 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd81e expref: 25 pid: 15621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.461892:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919047f90300) 00010000:00010000:2.0:1785787839.461897:0:14302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785787839.462085:0:14302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85a7a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.462100:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85a7a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.462118:0:14302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85a7a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785787839.462169:0:14302:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:2.0:1785787839.462194:0:14302:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004733d1cd reply state 0000000050b10a22 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85a7a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787839.462203:0:14302:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785787839.462301:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b6c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aabe278a-8cfd-4235-9dd3-056b28921491+27:14527:x1872533744905472:12345-192.168.203.53@tcp:36:truncate.0 Request processed in 542us (699us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1785787839.462308:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 37 00000020:00080000:2.0:1785787839.462327:0:14302:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1785787839.470355:0:3320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85a7a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.470380:0:3320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85a7a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.470388:0:3320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85a7a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.470394:0:3320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677ce00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787839.470399:0:3320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85a7a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.470408:0:3320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85a7a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.470424:0:3320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919047f90300) 00010000:00010000:2.0:1785787839.470427:0:3320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787839.470432:0:3320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85a7a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.470438:0:3320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85a7a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787839.477029:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785787839.751797:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787839.751972:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744905600 00000100:00100000:2.0:1785787839.751981:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744905600 00000100:00100000:2.0:1785787839.752036:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 38 00000100:00100000:2.0:1785787839.752045:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b6ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aabe278a-8cfd-4235-9dd3-056b28921491+26:14541:x1872533744905600:12345-192.168.203.53@tcp:101:stat.0 00010000:00010000:2.0:1785787839.752067:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787839.752087:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85a81 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd825 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.752164:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677de00/0xe2c2ff68a6e85a88 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.752177:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677de00/0xe2c2ff68a6e85a88 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.752189:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677de00/0xe2c2ff68a6e85a88 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.752203:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85a8f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.752209:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85a8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.752215:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85a8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.752317:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c400/0xe2c2ff68a6e85a96 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.752335:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c400/0xe2c2ff68a6e85a96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.752342:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c400/0xe2c2ff68a6e85a96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787839.752382:0:14303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1785787839.752387:0:14303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785787839.752406:0:14303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c400/0xe2c2ff68a6e85a96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.752428:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c400/0xe2c2ff68a6e85a96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.752437:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677de00/0xe2c2ff68a6e85a88 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.752442:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677de00/0xe2c2ff68a6e85a88 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.752448:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677de00/0xe2c2ff68a6e85a88 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.752454:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677de00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787839.752458:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677de00/0xe2c2ff68a6e85a88 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.752465:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677de00/0xe2c2ff68a6e85a88 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.752476:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff919047f90900) 00010000:00010000:2.0:1785787839.752480:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787839.752484:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677de00/0xe2c2ff68a6e85a88 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.752489:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677de00/0xe2c2ff68a6e85a88 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.752501:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85a8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.752506:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85a8f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.752517:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85a8f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.752521:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677cc00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787839.752524:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85a8f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.752530:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85a8f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.752538:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff919047f90c00) 00010000:00010000:2.0:1785787839.752540:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787839.752543:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85a8f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.752548:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85a8f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.752579:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85a81 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd825 expref: 28 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.752592:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c400/0xe2c2ff68a6e85a96 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd825 expref: 27 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.752599:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919047f90300) 00010000:00010000:2.0:1785787839.752601:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785787839.752603:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677c400, rc 0) 00000100:00100000:2.0:1785787839.752661:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b6ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aabe278a-8cfd-4235-9dd3-056b28921491+27:14541:x1872533744905600:12345-192.168.203.53@tcp:101:stat.0 Request processed in 617us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787839.752676:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 38 00000100:00100000:1.0:1785787839.916744:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787839.917921:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744905856 00000100:00100000:2.0:1785787839.917931:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744905856 00000100:00100000:2.0:1785787839.917986:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 39 00000100:00100000:2.0:1785787839.917995:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b6c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aabe278a-8cfd-4235-9dd3-056b28921491+27:14551:x1872533744905856:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:2.0:1785787839.918014:0:14302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787839.918034:0:14302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85a9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd82c expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787839.918136:0:14302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1785787839.918278:0:14302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85a9d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd82c expref: 29 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.918292:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919047f90a00) 00010000:00010000:2.0:1785787839.918295:0:14302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785787839.918299:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85a9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd82c expref: 29 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787839.918313:0:14302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677ce00, rc 0) 00000100:00100000:2.0:1785787839.918376:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b6c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aabe278a-8cfd-4235-9dd3-056b28921491+28:14551:x1872533744905856:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 382us (1640us total) trans 8589934614 rc 301/301 00000100:00100000:2.0:1785787839.918383:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 39 00000100:00100000:3.0:1785787839.922530:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787839.922610:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744906112 00000100:00100000:2.0:1785787839.922618:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744906112 00000100:00100000:2.0:1785787839.922671:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 10 00000100:00100000:2.0:1785787839.922680:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905fac2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aabe278a-8cfd-4235-9dd3-056b28921491+28:14551:x1872533744906112:12345-192.168.203.53@tcp:35:lfs.0 00000100:00100000:2.0:1785787839.922928:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905fac2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aabe278a-8cfd-4235-9dd3-056b28921491+29:14551:x1872533744906112:12345-192.168.203.53@tcp:35:lfs.0 Request processed in 248us (404us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1785787839.922935:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 10 00000100:00100000:1.0:1785787840.039902:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787840.039996:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744906368 00000100:00100000:2.0:1785787840.040007:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744906368 00000100:00100000:2.0:1785787840.040066:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 40 00000100:00100000:2.0:1785787840.040075:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b6c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aabe278a-8cfd-4235-9dd3-056b28921491+29:14557:x1872533744906368:12345-192.168.203.53@tcp:101:bash.0 00010000:00010000:2.0:1785787840.040098:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787840.040128:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85aab lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd833 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787840.040222:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85ab2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787840.040245:0:14303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e859e7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7f4 expref: 30 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787840.040253:0:14303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c400/0xe2c2ff68a6e85a96 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd825 expref: 30 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787840.040261:0:14303:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85ab2 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787840.040292:0:14303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c400/0xe2c2ff68a6e85a96 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd825 expref: 30 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787840.040304:0:14303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c400/0xe2c2ff68a6e85a96 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd825 expref: 30 pid: 14303 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787840.040336:0:14303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14303:1872533770065792:192.168.203.53@tcp:104: 00010000:00010000:2.0:1785787840.040567:0:14303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e859e7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7f4 expref: 30 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787840.040584:0:14303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e859e7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7f4 expref: 30 pid: 14301 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787840.040594:0:14303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907764df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14303:1872533770065920:192.168.203.53@tcp:104: 00000100:00100000:2.0:1785787840.040618:0:14303:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190507ea3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785787840.060691:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787840.060763:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787840.060996:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744906624 00000100:00100000:3.0:1785787840.061005:0:14286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744906624 00010000:00010000:3.0:1785787840.061040:0:14286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e859e7 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7f4 expref: 31 pid: 14301 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787840.061072:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744906496 00000100:00100000:3.0:1785787840.061075:0:14286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744906496 00010000:00010000:3.0:1785787840.061098:0:14286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c400/0xe2c2ff68a6e85a96 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd825 expref: 32 pid: 14303 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787840.061123:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 11 00000100:00100000:3.0:1785787840.061130:0:14286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907fd6d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aabe278a-8cfd-4235-9dd3-056b28921491+32:2390:x1872533744906624:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785787840.061142:0:14286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787840.061149:0:14286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e859e7 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7f4 expref: 32 pid: 14301 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787840.061160:0:14286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e859e7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7f4 expref: 32 pid: 14301 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787840.061180:0:14286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919047f90300) 00010000:00010000:3.0:1785787840.061185:0:14286:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85ab2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787840.061193:0:14286:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85ab2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787840.061199:0:14286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787840.061251:0:14286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907fd6d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aabe278a-8cfd-4235-9dd3-056b28921491+32:2390:x1872533744906624:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 121us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787840.061258:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 11 00000100:00100000:3.0:1785787840.061296:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 12 00000100:00100000:3.0:1785787840.061302:0:14286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b6c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aabe278a-8cfd-4235-9dd3-056b28921491+31:2390:x1872533744906496:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785787840.061309:0:14286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787840.061313:0:14286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c400/0xe2c2ff68a6e85a96 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd825 expref: 31 pid: 14303 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787840.061328:0:14286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c400/0xe2c2ff68a6e85a96 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd825 expref: 31 pid: 14303 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787840.061339:0:14286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919047f90300) 00010000:00010000:3.0:1785787840.061342:0:14286:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85ab2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787840.061349:0:14286:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85ab2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787840.061356:0:14286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85ab2 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787840.061383:0:14286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787840.061400:0:14286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b6c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aabe278a-8cfd-4235-9dd3-056b28921491+31:2390:x1872533744906496:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 98us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787840.061407:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 12 00010000:00010000:2.0:1785787840.062059:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c400/0xe2c2ff68a6e85a96 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd825 expref: 30 pid: 14303 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787840.062076:0:14303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14303:1872533770065792:192.168.203.53@tcp:104: 00010000:00010000:2.0:1785787840.062088:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e859e7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd7f4 expref: 29 pid: 14301 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787840.062097:0:14303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907764df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14303:1872533770065920:192.168.203.53@tcp:104: 00010000:00010000:2.0:1785787840.062126:0:14303:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85ab2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787840.062142:0:14303:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85ab2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787840.062147:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85ab2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787840.062174:0:14303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:2.0:1785787840.065038:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85aab lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd833 expref: 30 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787840.065063:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85ab2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd833 expref: 29 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787840.065071:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919047f90300) 00010000:00010000:2.0:1785787840.065074:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1785787840.065077:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677cc00, rc 0) 00000100:00100000:2.0:1785787840.065139:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b6c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aabe278a-8cfd-4235-9dd3-056b28921491+29:14557:x1872533744906368:12345-192.168.203.53@tcp:101:bash.0 Request processed in 25064us (25244us total) trans 8589934616 rc 0/0 00000100:00100000:2.0:1785787840.065147:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 40 00000100:00100000:1.0:1785787840.067652:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787840.067715:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744906880 00000100:00100000:0.0:1785787840.067724:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744906880 00000100:00100000:0.0:1785787840.067765:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 41 00000100:00100000:0.0:1785787840.067773:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b6cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aabe278a-8cfd-4235-9dd3-056b28921491+29:14557:x1872533744906880:12345-192.168.203.53@tcp:36:bash.0 00010000:00010000:0.0:1785787840.068025:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e85ac0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787840.068040:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e85ac0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787840.068066:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e85ac0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785787840.068120:0:14301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:0.0:1785787840.068143:0:14301:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005193f081 reply state 00000000644fe5ef transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e85ac0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787840.068152:0:14301:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785787840.068225:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b6cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aabe278a-8cfd-4235-9dd3-056b28921491+32:14557:x1872533744906880:12345-192.168.203.53@tcp:36:bash.0 Request processed in 452us (578us total) trans 8589934618 rc 0/0 00000100:00100000:0.0:1785787840.068240:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 41 00000020:00080000:0.0:1785787840.068244:0:14301:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1785787840.074257:0:3319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e85ac0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787840.074274:0:3319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e85ac0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787840.074281:0:3319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e85ac0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787840.074287:0:3319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919052f5ee00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1785787840.074291:0:3319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e85ac0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787840.074298:0:3319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e85ac0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787840.074315:0:3319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919047f90300) 00010000:00010000:0.0:1785787840.074317:0:3319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785787840.074338:0:3319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e85ac0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787840.074343:0:3319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e85ac0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787840.089978:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787840.090165:0:15621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744907008 00000100:00100000:0.0:1785787840.090174:0:15621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744907008 00000100:00100000:0.0:1785787840.090232:0:15621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 42 00000100:00100000:0.0:1785787840.090241:0:15621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aabe278a-8cfd-4235-9dd3-056b28921491+31:14557:x1872533744907008:12345-192.168.203.53@tcp:101:bash.0 00010000:00010000:0.0:1785787840.090264:0:15621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787840.090283:0:15621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fa00/0xe2c2ff68a6e85ac7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd83a expref: -99 pid: 15621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787840.090337:0:15621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fa00/0xe2c2ff68a6e85ac7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd83a expref: 32 pid: 15621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787840.090350:0:15621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fa00/0xe2c2ff68a6e85ac7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd83a expref: 32 pid: 15621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787840.090376:0:15621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919047f90300) 00010000:00010000:0.0:1785787840.090379:0:15621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1785787840.090383:0:15621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919052f5fa00, rc 0) 00000100:00100000:0.0:1785787840.090427:0:15621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aabe278a-8cfd-4235-9dd3-056b28921491+32:14557:x1872533744907008:12345-192.168.203.53@tcp:101:bash.0 Request processed in 187us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787840.090433:0:15621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 42 00000100:00100000:1.0:1785787840.109480:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787840.109560:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744907136 00000100:00100000:0.0:1785787840.109569:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744907136 00000100:00100000:0.0:1785787840.109635:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 43 00000100:00100000:0.0:1785787840.109657:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b6c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aabe278a-8cfd-4235-9dd3-056b28921491+32:14557:x1872533744907136:12345-192.168.203.53@tcp:101:bash.0 00010000:00010000:0.0:1785787840.109676:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787840.109695:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e85ace lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd841 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787840.109772:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f000/0xe2c2ff68a6e85ad5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787840.109786:0:14301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85ab2 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd833 expref: 33 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787840.109795:0:14301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f000/0xe2c2ff68a6e85ad5 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787840.109824:0:14301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85ab2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd833 expref: 33 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787840.109871:0:14301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85ab2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd833 expref: 33 pid: 14303 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787840.109963:0:14301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bd9a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14301:1872533770066048:192.168.203.53@tcp:104: 00000100:00100000:0.0:1785787840.110040:0:14301:0:(client.c:2702:ptlrpc_set_wait()) set ffff91907bdc2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1785787840.117273:0:14301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bd9a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14301:1872533770066048:192.168.203.53@tcp:104: 00010000:00010000:0.0:1785787840.117302:0:14301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f000/0xe2c2ff68a6e85ad5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787840.126908:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787840.126985:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744907264 00000100:00100000:3.0:1785787840.126994:0:14286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744907264 00010000:00010000:3.0:1785787840.127035:0:14286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85ab2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd833 expref: 34 pid: 14303 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787840.127065:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 13 00000100:00100000:3.0:1785787840.127074:0:14286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b6c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aabe278a-8cfd-4235-9dd3-056b28921491+34:2390:x1872533744907264:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785787840.127087:0:14286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785787840.127095:0:14286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85ab2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd833 expref: 34 pid: 14303 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787840.127129:0:14286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85ab2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd833 expref: 34 pid: 14303 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787840.127149:0:14286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85ab2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd833 expref: 34 pid: 14303 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787840.127165:0:14286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919047f90300) 00010000:00010000:3.0:1785787840.127169:0:14286:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f000/0xe2c2ff68a6e85ad5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787840.127178:0:14286:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f000/0xe2c2ff68a6e85ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787840.127186:0:14286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f000/0xe2c2ff68a6e85ad5 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787840.127217:0:14286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785787840.127268:0:14286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b6c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aabe278a-8cfd-4235-9dd3-056b28921491+33:2390:x1872533744907264:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 196us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787840.127276:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 13 00010000:00010000:2.0:1785787840.127384:0:14301:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f000/0xe2c2ff68a6e85ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787840.127392:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f000/0xe2c2ff68a6e85ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787840.127432:0:14301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1785787840.127436:0:14301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785787840.127455:0:14301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f000/0xe2c2ff68a6e85ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787840.127482:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5ee00/0xe2c2ff68a6e85ace lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd841 expref: 33 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787840.127497:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f000/0xe2c2ff68a6e85ad5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd841 expref: 32 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787840.127511:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919047f90300) 00010000:00010000:2.0:1785787840.127513:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785787840.127516:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919052f5f000, rc 0) 00000100:00100000:2.0:1785787840.127539:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b6c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aabe278a-8cfd-4235-9dd3-056b28921491+32:14557:x1872533744907136:12345-192.168.203.53@tcp:101:bash.0 Request processed in 17885us (18069us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787840.127546:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 43 00000100:00100000:3.0:1785787840.137469:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787840.137553:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744907520 00000100:00100000:1.0:1785787840.137562:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744907520 00000100:00100000:1.0:1785787840.137629:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2 00000100:00100000:1.0:1785787840.137638:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aabe278a-8cfd-4235-9dd3-056b28921491+32:14557:x1872533744907520:12345-192.168.203.53@tcp:103:bash.0 00010000:00010000:1.0:1785787840.137652:0:14288:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1785787840.137675:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f000/0xe2c2ff68a6e85ad5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd841 expref: 32 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787840.137695:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5fa00/0xe2c2ff68a6e85ac7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd83a expref: 31 pid: 15621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787840.137705:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919047f90300) 00010000:00010000:1.0:1785787840.137715:0:14288:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785787840.137771:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aabe278a-8cfd-4235-9dd3-056b28921491+30:14557:x1872533744907520:12345-192.168.203.53@tcp:103:bash.0 Request processed in 134us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787840.137779:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2 00000100:00100000:1.0:1785787840.139384:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787840.139450:0:15621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744907648 00000100:00100000:0.0:1785787840.139456:0:15621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744907648 00000100:00100000:0.0:1785787840.139509:0:15621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 44 00000100:00100000:0.0:1785787840.139516:0:15621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b6cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aabe278a-8cfd-4235-9dd3-056b28921491+30:14557:x1872533744907648:12345-192.168.203.53@tcp:58:bash.0 00010000:00010000:0.0:1785787840.139605:0:15621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f600/0xe2c2ff68a6e85adc lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787840.139619:0:15621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f600/0xe2c2ff68a6e85adc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787840.139630:0:15621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f600/0xe2c2ff68a6e85adc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785787840.140763:0:15621:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1785787840.146540:0:15621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1785787840.148466:0:15621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1785787840.148596:0:15621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b6cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aabe278a-8cfd-4235-9dd3-056b28921491+30:14557:x1872533744907648:12345-192.168.203.53@tcp:58:bash.0 Request processed in 9075us (9210us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787840.148608:0:15621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 44 00000100:00100000:3.0:1785787840.150521:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787840.151661:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744907776 00000100:00100000:0.0:1785787840.151671:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744907776 00000100:00100000:0.0:1785787840.151723:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 45 00000100:00100000:0.0:1785787840.151732:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aabe278a-8cfd-4235-9dd3-056b28921491+30:14557:x1872533744907776:12345-192.168.203.53@tcp:101:bash.0 00010000:00010000:0.0:1785787840.151751:0:14302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785787840.151771:0:14302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e85ae3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd848 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787840.151819:0:14302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f600/0xe2c2ff68a6e85adc lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787840.151861:0:14302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e85ae3 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd848 expref: 31 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787840.152172:0:14302:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f600/0xe2c2ff68a6e85adc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787840.152186:0:14302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e85ae3 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd848 expref: 31 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787840.152198:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919059e3e600) 00010000:00010000:0.0:1785787840.152201:0:14302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1785787840.152205:0:14302:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e85ae3 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd848 expref: 31 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787840.152213:0:14302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919052f5e400, rc 0) 00000100:00100000:0.0:1785787840.153308:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aabe278a-8cfd-4235-9dd3-056b28921491+31:14557:x1872533744907776:12345-192.168.203.53@tcp:101:bash.0 Request processed in 1574us (2788us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787840.153317:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 45 00010000:00010000:2.0:1785787840.499011:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1785787841.076084:0:14333:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1785787841.076119:0:14333:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1785787841.076370:0:14333:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1785787841.076379:0:14333:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1785787841.076589:0:14333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905faf6300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14333:1872533770066176:192.168.203.53@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1785787841.076735:0:14333:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190776bdc00 going to sleep for 11 seconds 00000100:00100000:3.0:1785787841.080532:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787841.081376:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744907904 00000100:00100000:1.0:1785787841.081398:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744907904 00000100:00100000:1.0:1785787841.081482:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 0 00000100:00100000:1.0:1785787841.081493:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:aabe278a-8cfd-4235-9dd3-056b28921491+32:14558:x1872533744907904:12345-192.168.203.53@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1785787841.081591:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:aabe278a-8cfd-4235-9dd3-056b28921491+32:14558:x1872533744907904:12345-192.168.203.53@tcp:900:lhsmtool_posix.0 Request processed in 99us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787841.081600:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 0 00000100:00080000:3.0:1785787841.081842:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785787841.087129:0:14333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905faf6300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14333:1872533770066176:192.168.203.53@tcp:107:hsm_cdtr.0 00000001:00080000:3.0:1785787841.088961:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934618 is committed 00000001:00080000:3.0:1785787841.089007:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1785787841.091717:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787841.091916:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744908032 00000100:00100000:1.0:1785787841.091928:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744908032 00000100:00100000:1.0:1785787841.092002:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 46 00000100:00100000:1.0:1785787841.092013:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aabe278a-8cfd-4235-9dd3-056b28921491+10:14558:x1872533744908032:12345-192.168.203.53@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1785787841.092052:0:14303:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1785787841.092195:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aabe278a-8cfd-4235-9dd3-056b28921491+10:14558:x1872533744908032:12345-192.168.203.53@tcp:53:lhsmtool_posix.0 Request processed in 184us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787841.092204:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 46 00000100:00100000:1.0:1785787841.100755:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787841.100877:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744908160 00000100:00100000:2.0:1785787841.100891:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744908160 00000100:00100000:0.0:1785787841.101030:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 47 00000100:00100000:0.0:1785787841.101045:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b6c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aabe278a-8cfd-4235-9dd3-056b28921491+10:14558:x1872533744908160:12345-192.168.203.53@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1785787841.101150:0:14302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e85aea lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787841.101169:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e85aea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787841.101185:0:14302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e85aea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.102380:0:14302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4c00/0xe2c2ff68a6e85af1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.102395:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4c00/0xe2c2ff68a6e85af1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.102463:0:14302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4c00/0xe2c2ff68a6e85af1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.102499:0:14302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4600/0xe2c2ff68a6e85af8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.102508:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4600/0xe2c2ff68a6e85af8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.102531:0:14302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4600/0xe2c2ff68a6e85af8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785787841.102593:0:14302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1785787841.102599:0:14302:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1785787841.102620:0:14302:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4600/0xe2c2ff68a6e85af8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.102634:0:14302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e85aea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.102641:0:14302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e85aea lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.102649:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e85aea lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.102655:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919052f5f200 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787841.102661:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e85aea lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.102669:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e85aea lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.102683:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff919047f90e00) 00010000:00010000:1.0:1785787841.102686:0:14302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785787841.102692:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e85aea lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.102699:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e85aea lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.102724:0:14302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4c00/0xe2c2ff68a6e85af1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.102731:0:14302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4c00/0xe2c2ff68a6e85af1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.102736:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4c00/0xe2c2ff68a6e85af1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.102742:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190443c4c00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787841.102745:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4c00/0xe2c2ff68a6e85af1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.102752:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4c00/0xe2c2ff68a6e85af1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.102760:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff919059e3ef00) 00010000:00010000:1.0:1785787841.102763:0:14302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785787841.102766:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4c00/0xe2c2ff68a6e85af1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.102772:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4c00/0xe2c2ff68a6e85af1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.102788:0:14302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4600/0xe2c2ff68a6e85af8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.102795:0:14302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4600/0xe2c2ff68a6e85af8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.102801:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4600/0xe2c2ff68a6e85af8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.102812:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190443c4600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787841.102816:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4600/0xe2c2ff68a6e85af8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.102823:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4600/0xe2c2ff68a6e85af8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.102867:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919059e3e600) 00010000:00010000:1.0:1785787841.102870:0:14302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785787841.102874:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4600/0xe2c2ff68a6e85af8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.102880:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4600/0xe2c2ff68a6e85af8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787841.104081:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b6c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aabe278a-8cfd-4235-9dd3-056b28921491+10:14558:x1872533744908160:12345-192.168.203.53@tcp:34:lhsmtool_posix.0 Request processed in 3029us (3329us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787841.104096:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 47 00000100:00100000:3.0:1785787841.107669:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787841.111102:0:15621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744908416 00000100:00100000:0.0:1785787841.111141:0:15621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744908416 00000100:00100000:1.0:1785787841.111766:0:15621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 48 00000100:00100000:1.0:1785787841.111781:0:15621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aabe278a-8cfd-4235-9dd3-056b28921491+10:14558:x1872533744908416:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1785787841.111809:0:15621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787841.111863:0:15621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c5600/0xe2c2ff68a6e85aff lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd84f expref: -99 pid: 15621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.112044:0:15621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c5800/0xe2c2ff68a6e85b06 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.112063:0:15621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c5800/0xe2c2ff68a6e85b06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.112086:0:15621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c5800/0xe2c2ff68a6e85b06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785787841.112102:0:15621:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1785787841.112309:0:15621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c5800/0xe2c2ff68a6e85b06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.112319:0:15621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c5800/0xe2c2ff68a6e85b06 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.112326:0:15621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c5800/0xe2c2ff68a6e85b06 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.112333:0:15621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190443c5800 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:1.0:1785787841.112338:0:15621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c5800/0xe2c2ff68a6e85b06 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.112347:0:15621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c5800/0xe2c2ff68a6e85b06 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.112372:0:15621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919059e3e600) 00010000:00010000:1.0:1785787841.112375:0:15621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785787841.112380:0:15621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c5800/0xe2c2ff68a6e85b06 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.112387:0:15621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c5800/0xe2c2ff68a6e85b06 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.112483:0:15621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c5600/0xe2c2ff68a6e85aff lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd84f expref: 12 pid: 15621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.112507:0:15621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff919047f90e00) 00010000:00010000:1.0:1785787841.112510:0:15621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785787841.112514:0:15621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c5600/0xe2c2ff68a6e85aff lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd84f expref: 12 pid: 15621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.112524:0:15621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190443c5600, rc 0) 00000100:00100000:1.0:1785787841.112602:0:15621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aabe278a-8cfd-4235-9dd3-056b28921491+11:14558:x1872533744908416:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 825us (4943us total) trans 8589934619 rc 301/301 00000100:00100000:1.0:1785787841.112610:0:15621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 48 00000100:00100000:2.0:1785787841.115682:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787841.115817:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744908544 00000100:00100000:0.0:1785787841.115854:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744908544 00000100:00100000:0.0:1785787841.115921:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 49 00000100:00100000:0.0:1785787841.115940:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aabe278a-8cfd-4235-9dd3-056b28921491+11:14558:x1872533744908544:12345-192.168.203.53@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1785787841.115986:0:14301:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1785787841.116106:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aabe278a-8cfd-4235-9dd3-056b28921491+11:14558:x1872533744908544:12345-192.168.203.53@tcp:53:lhsmtool_posix.0 Request processed in 175us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787841.116114:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 49 00000100:00100000:2.0:1785787841.119775:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787841.130621:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744908800 00000100:00100000:1.0:1785787841.130641:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744908800 00000100:00100000:1.0:1785787841.130737:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 50 00000100:00100000:1.0:1785787841.130749:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907764e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aabe278a-8cfd-4235-9dd3-056b28921491+11:14558:x1872533744908800:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1785787841.130774:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787841.130799:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c5600/0xe2c2ff68a6e85b14 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd856 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785787841.133782:0:14303:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:1.0:1785787841.133793:0:14303:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:1.0:1785787841.134007:0:14303:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:1.0:1785787841.134327:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c5800/0xe2c2ff68a6e85b1b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.134344:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c5800/0xe2c2ff68a6e85b1b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.134365:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c5800/0xe2c2ff68a6e85b1b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.134549:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c5600/0xe2c2ff68a6e85b14 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd856 expref: 14 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.134566:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c5800/0xe2c2ff68a6e85b1b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd856 expref: 13 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.134575:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9190557cbe00) 00010000:00010000:1.0:1785787841.134577:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785787841.134580:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190443c5800, rc 0) 00000100:00100000:1.0:1785787841.134650:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907764e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aabe278a-8cfd-4235-9dd3-056b28921491+13:14558:x1872533744908800:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 3902us (14884us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1785787841.134659:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 50 00000100:00100000:3.0:1785787841.147812:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787841.150639:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744909056 00000100:00100000:0.0:1785787841.150660:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744909056 00000100:00100000:0.0:1785787841.150745:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 51 00000100:00100000:0.0:1785787841.150758:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aabe278a-8cfd-4235-9dd3-056b28921491+13:14558:x1872533744909056:12345-192.168.203.53@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1785787841.150886:0:14301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785787841.152039:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c5800/0xe2c2ff68a6e85b1b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd856 expref: 13 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787841.152067:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9190557cbe00) 00010000:00010000:0.0:1785787841.152082:0:14301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785787841.152112:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e000/0xe2c2ff68a6e85b29 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787841.152130:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e000/0xe2c2ff68a6e85b29 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787841.152142:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e000/0xe2c2ff68a6e85b29 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787841.152175:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e85b30 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9fc959ab bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787841.152202:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e85b30 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9fc959ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787841.152210:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e85b30 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9fc959ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.154502:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e000/0xe2c2ff68a6e85b29 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.154521:0:14301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e000/0xe2c2ff68a6e85b29 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.154530:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e000/0xe2c2ff68a6e85b29 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.154537:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919052f5e000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787841.154543:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e000/0xe2c2ff68a6e85b29 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.154552:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e000/0xe2c2ff68a6e85b29 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.155400:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff919047f90900) 00010000:00010000:2.0:1785787841.155405:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787841.155411:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e000/0xe2c2ff68a6e85b29 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.155419:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e000/0xe2c2ff68a6e85b29 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.155437:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e85b30 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9fc959ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.155443:0:14301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e85b30 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9fc959ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.155450:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e85b30 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9fc959ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.155455:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919052f5f200 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787841.155458:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e85b30 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9fc959ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.155465:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e85b30 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9fc959ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.155474:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x9fc959ab (ffff919059e3e300) 00010000:00010000:2.0:1785787841.155476:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787841.155479:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e85b30 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9fc959ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.155485:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f200/0xe2c2ff68a6e85b30 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9fc959ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787841.158459:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aabe278a-8cfd-4235-9dd3-056b28921491+12:14558:x1872533744909056:12345-192.168.203.53@tcp:36:lhsmtool_posix.0 Request processed in 7689us (10643us total) trans 0 rc -2/-2 00000100:00100000:2.0:1785787841.158474:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 51 00000100:00100000:2.0:1785787841.172762:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787841.173389:0:15621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744909184 00000100:00100000:1.0:1785787841.173403:0:15621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744909184 00000100:00100000:1.0:1785787841.173478:0:15621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 52 00000100:00100000:1.0:1785787841.173489:0:15621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aabe278a-8cfd-4235-9dd3-056b28921491+12:14558:x1872533744909184:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1785787841.173514:0:15621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787841.173542:0:15621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c5600/0xe2c2ff68a6e85b37 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd85d expref: -99 pid: 15621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.173586:0:15621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4600/0xe2c2ff68a6e85b3e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.173602:0:15621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4600/0xe2c2ff68a6e85b3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.173615:0:15621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4600/0xe2c2ff68a6e85b3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.173748:0:15621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c5600/0xe2c2ff68a6e85b37 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd85d expref: 14 pid: 15621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.173769:0:15621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4600/0xe2c2ff68a6e85b3e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd85d expref: 13 pid: 15621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.173779:0:15621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9190557cba00) 00010000:00010000:1.0:1785787841.173782:0:15621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1785787841.173787:0:15621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190443c4600, rc 0) 00000100:00100000:1.0:1785787841.173897:0:15621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aabe278a-8cfd-4235-9dd3-056b28921491+13:14558:x1872533744909184:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 409us (1148us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787841.175708:0:15621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 52 00000100:00100000:0.0:1785787841.183624:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787841.183705:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744909440 00000100:00100000:1.0:1785787841.183717:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744909440 00000100:00100000:1.0:1785787841.183786:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 53 00000100:00100000:1.0:1785787841.183796:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aabe278a-8cfd-4235-9dd3-056b28921491+13:14558:x1872533744909440:12345-192.168.203.53@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1785787841.183957:0:14302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c5600/0xe2c2ff68a6e85b45 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.183976:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c5600/0xe2c2ff68a6e85b45 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.183990:0:14302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c5600/0xe2c2ff68a6e85b45 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1785787841.184618:0:14302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1785787841.184630:0:14302:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628428801047ns, next at 629428798522ns, rc = 0 00000004:00010000:1.0:1785787841.184741:0:14302:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005895f0d4 reply state 00000000c7032df3 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c5600/0xe2c2ff68a6e85b45 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787841.184752:0:14302:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785787841.184881:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aabe278a-8cfd-4235-9dd3-056b28921491+15:14558:x1872533744909440:12345-192.168.203.53@tcp:36:lhsmtool_posix.0 Request processed in 1086us (1272us total) trans 8589934621 rc 0/0 00000100:00100000:1.0:1785787841.184891:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 53 00000100:00100000:3.0:1785787841.190723:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00010000:00010000:2.0:1785787841.191065:0:3320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c5600/0xe2c2ff68a6e85b45 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.191081:0:3320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c5600/0xe2c2ff68a6e85b45 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.191101:0:3320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c5600/0xe2c2ff68a6e85b45 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.191109:0:3320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190443c5600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787841.191115:0:3320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c5600/0xe2c2ff68a6e85b45 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.191124:0:3320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c5600/0xe2c2ff68a6e85b45 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.191144:0:3320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9190557cba00) 00010000:00010000:2.0:1785787841.191147:0:3320:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1785787841.191152:0:3320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c5600/0xe2c2ff68a6e85b45 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.191160:0:3320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c5600/0xe2c2ff68a6e85b45 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787841.192679:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744909568 00000100:00100000:1.0:1785787841.192696:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744909568 00000100:00100000:1.0:1785787841.192767:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 54 00000100:00100000:1.0:1785787841.192778:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aabe278a-8cfd-4235-9dd3-056b28921491+14:14558:x1872533744909568:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1785787841.192808:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787841.192875:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4c00/0xe2c2ff68a6e85b4c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd864 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.193063:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4c00/0xe2c2ff68a6e85b4c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd864 expref: 15 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.193082:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4c00/0xe2c2ff68a6e85b4c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd864 expref: 15 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.193117:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9190557cba00) 00010000:00010000:1.0:1785787841.193120:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1785787841.193124:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190443c4c00, rc 0) 00000100:00100000:1.0:1785787841.193441:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aabe278a-8cfd-4235-9dd3-056b28921491+15:14558:x1872533744909568:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 664us (2731us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787841.193450:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 54 00000100:00100000:3.0:1785787841.200376:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787841.200510:0:14939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744909696 00000100:00100000:2.0:1785787841.200522:0:14939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744909696 00000100:00100000:2.0:1785787841.200620:0:14939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 13 00000100:00100000:2.0:1785787841.200632:0:14939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aabe278a-8cfd-4235-9dd3-056b28921491+5:2390:x1872533744909696:12345-192.168.203.53@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1785787841.201059:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785787841.202914:0:14939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aabe278a-8cfd-4235-9dd3-056b28921491+6:2390:x1872533744909696:12345-192.168.203.53@tcp:2:lhsmtool_posix.0 Request processed in 2276us (2551us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1785787841.202928:0:14939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 13 00000100:00100000:2.0:1785787841.216349:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787841.216469:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744909952 00000100:00100000:0.0:1785787841.216481:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744909952 00000100:00100000:0.0:1785787841.216547:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 11 00000100:00100000:0.0:1785787841.216557:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aabe278a-8cfd-4235-9dd3-056b28921491+15:14558:x1872533744909952:12345-192.168.203.53@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1785787841.216887:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aabe278a-8cfd-4235-9dd3-056b28921491+16:14558:x1872533744909952:12345-192.168.203.53@tcp:35:lhsmtool_posix.0 Request processed in 330us (734us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1785787841.216895:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 11 00000100:00100000:3.0:1785787841.221768:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787841.223488:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744910208 00000100:00100000:1.0:1785787841.223524:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744910208 00000100:00100000:1.0:1785787841.223609:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 55 00000100:00100000:1.0:1785787841.223622:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aabe278a-8cfd-4235-9dd3-056b28921491+16:14558:x1872533744910208:12345-192.168.203.53@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1785787841.223772:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aabe278a-8cfd-4235-9dd3-056b28921491+16:14558:x1872533744910208:12345-192.168.203.53@tcp:57:lhsmtool_posix.0 Request processed in 152us (2016us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787841.223781:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 55 00000100:00100000:3.0:1785787841.227509:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787841.227604:0:15621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744910336 00000100:00100000:2.0:1785787841.227614:0:15621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744910336 00000100:00100000:2.0:1785787841.227677:0:15621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 56 00000100:00100000:2.0:1785787841.227688:0:15621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aabe278a-8cfd-4235-9dd3-056b28921491+16:14558:x1872533744910336:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1785787841.227712:0:15621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787841.227738:0:15621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d600/0xe2c2ff68a6e85b53 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd86b expref: -99 pid: 15621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.227816:0:15621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e85b5a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.227870:0:15621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e85b5a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.227884:0:15621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e85b5a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785787841.228385:0:15621:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1785787841.228411:0:15621:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e85b5a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787841.228442:0:15621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d600/0xe2c2ff68a6e85b53 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd86b expref: 18 pid: 15621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787841.228463:0:15621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e85b5a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd86b expref: 17 pid: 15621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787841.228473:0:15621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9190557cba00) 00010000:00010000:0.0:1785787841.228476:0:15621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1785787841.228480:0:15621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677c800, rc 0) 00000100:00100000:0.0:1785787841.228556:0:15621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aabe278a-8cfd-4235-9dd3-056b28921491+17:14558:x1872533744910336:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 869us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787841.228564:0:15621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 56 00000100:00100000:0.0:1785787841.232155:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787841.232522:0:14938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744910464 00000100:00100000:2.0:1785787841.232533:0:14938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744910464 00000100:00100000:2.0:1785787841.232604:0:14938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 14 00000100:00100000:2.0:1785787841.232615:0:14938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bd98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aabe278a-8cfd-4235-9dd3-056b28921491+6:2391:x1872533744910464:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1785787841.232638:0:14938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787841.232678:0:14938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7c237a0/0xe2c2ff68a6e85b61 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd872 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785787841.232709:0:14938:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a70f5c1, blocks: 0x1 00010000:00010000:2.0:1785787841.232731:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=628s v=(0 0) 00010000:00010000:2.0:1785787841.232736:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785787841.232747:0:14938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7c237a0/0xe2c2ff68a6e85b61 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd872 expref: 7 pid: 14938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.232768:0:14938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e7c237a0/0xe2c2ff68a6e85b61 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd872 expref: 7 pid: 14938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.232784:0:14938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677da00, rc 0) 00000100:00100000:2.0:1785787841.232884:0:14938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bd98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aabe278a-8cfd-4235-9dd3-056b28921491+7:2391:x1872533744910464:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 270us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787841.232891:0:14938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 14 00000100:00100000:3.0:1785787841.247590:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787841.247803:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744910720 00000100:00100000:1.0:1785787841.247815:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744910720 00000100:00100000:1.0:1785787841.247926:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 57 00000100:00100000:1.0:1785787841.247938:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aabe278a-8cfd-4235-9dd3-056b28921491+17:14558:x1872533744910720:12345-192.168.203.53@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1785787841.248064:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aabe278a-8cfd-4235-9dd3-056b28921491+17:14558:x1872533744910720:12345-192.168.203.53@tcp:57:lhsmtool_posix.0 Request processed in 128us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787841.248072:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 57 00000100:00100000:3.0:1785787841.252467:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787841.252693:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744910848 00000100:00100000:1.0:1785787841.252705:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744910848 00000100:00100000:1.0:1785787841.252769:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 58 00000100:00100000:1.0:1785787841.252779:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aabe278a-8cfd-4235-9dd3-056b28921491+17:14558:x1872533744910848:12345-192.168.203.53@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1785787841.290267:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:3.0:1785787841.290296:0:5843:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:2.0:1785787841.290541:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785787841.290566:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770066304:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1785787841.290651:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787841.290720:0:14939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770066304 00000100:00100000:2.0:1785787841.290728:0:14939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770066304 00000100:00100000:2.0:1785787841.290794:0:14939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1785787841.290803:0:14939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770066304:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1785787841.291014:0:14939:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1785787841.291018:0:14939:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1785787841.291021:0:14939:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1785787841.291023:0:14939:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1785787841 -> 1785787841 00002000:00010000:2.0:1785787841.291041:0:14939:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1785787841.291083:0:14939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3333:x1872533770066304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 280us (431us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1785787841.291808:0:14939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1785787841.291860:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1785787841.291899:0:3333:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff919077a9c380/2, rc 0, transno 8589934595 00000100:00100000:2.0:1785787841.292018:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770066304:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1785787841.294154:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aabe278a-8cfd-4235-9dd3-056b28921491+13:14558:x1872533744910848:12345-192.168.203.53@tcp:44:lhsmtool_posix.0 Request processed in 41366us (41688us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787841.294179:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 58 00000100:00100000:2.0:1785787841.303677:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787841.304065:0:14938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744910976 00000100:00100000:0.0:1785787841.304078:0:14938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744910976 00000100:00100000:0.0:1785787841.304167:0:14938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 16 00000100:00100000:0.0:1785787841.304178:0:14938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bc1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aabe278a-8cfd-4235-9dd3-056b28921491+7:2390:x1872533744910976:12345-192.168.203.53@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1785787841.304465:0:14938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bc1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aabe278a-8cfd-4235-9dd3-056b28921491+7:2390:x1872533744910976:12345-192.168.203.53@tcp:16:lhsmtool_posix.0 Request processed in 289us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787841.304475:0:14938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 16 00000100:00100000:3.0:1785787841.311790:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787841.312615:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744911232 00000100:00100000:1.0:1785787841.312629:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744911232 00000100:00100000:1.0:1785787841.312701:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 59 00000100:00100000:1.0:1785787841.312712:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aabe278a-8cfd-4235-9dd3-056b28921491+13:14558:x1872533744911232:12345-192.168.203.53@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1785787841.312780:0:14302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785787841.312848:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677c800/0xe2c2ff68a6e85b5a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd86b expref: 13 pid: 15621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.312871:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9190557cba00) 00010000:00010000:1.0:1785787841.312877:0:14302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785787841.313059:0:14302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4400/0xe2c2ff68a6e85b68 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.313077:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4400/0xe2c2ff68a6e85b68 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.313089:0:14302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4400/0xe2c2ff68a6e85b68 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785787841.313567:0:14302:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000009907f71 reply state 000000001c8e906b transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4400/0xe2c2ff68a6e85b68 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787841.313592:0:14302:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785787841.313875:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aabe278a-8cfd-4235-9dd3-056b28921491+14:14558:x1872533744911232:12345-192.168.203.53@tcp:36:lhsmtool_posix.0 Request processed in 1163us (2098us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1785787841.313884:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 59 00000100:00100000:2.0:1785787841.329714:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787841.329802:0:14937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744911360 00000100:00100000:1.0:1785787841.329815:0:14937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744911360 00000100:00100000:1.0:1785787841.329923:0:14937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 17 00000100:00100000:1.0:1785787841.329935:0:14937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bc19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aabe278a-8cfd-4235-9dd3-056b28921491+7:14558:x1872533744911360:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1785787841.329959:0:14937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785787841.329983:0:14937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2a2c889/0xe2c2ff68a6e85b6f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd879 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.330025:0:14937:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7c237a0/0xe2c2ff68a6e85b61 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd872 expref: 8 pid: 14938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.330053:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785787841.330058:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785787841.330065:0:14937:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a2c889/0xe2c2ff68a6e85b6f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd879 expref: 8 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.330120:0:14937:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e7c237a0/0xe2c2ff68a6e85b61 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd872 expref: 8 pid: 14938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.330138:0:14937:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e7c237a0/0xe2c2ff68a6e85b61 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd872 expref: 8 pid: 14938 timeout: 728 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787841.330155:0:14937:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b6cad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:14937:1872533770066432:192.168.203.53@tcp:104: 00000100:00100000:1.0:1785787841.330391:0:14937:0:(client.c:2702:ptlrpc_set_wait()) set ffff919046e0fc00 going to sleep for 11 seconds 00010000:00010000:0.0:1785787841.330494:0:3319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4400/0xe2c2ff68a6e85b68 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787841.330506:0:3319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4400/0xe2c2ff68a6e85b68 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787841.330514:0:3319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4400/0xe2c2ff68a6e85b68 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787841.330521:0:3319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190443c4400 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:0.0:1785787841.330527:0:3319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4400/0xe2c2ff68a6e85b68 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787841.330536:0:3319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4400/0xe2c2ff68a6e85b68 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787841.330556:0:3319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9190557cba00) 00010000:00010000:0.0:1785787841.330559:0:3319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785787841.330573:0:3319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4400/0xe2c2ff68a6e85b68 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787841.330580:0:3319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4400/0xe2c2ff68a6e85b68 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787841.335608:0:14937:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b6cad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:14937:1872533770066432:192.168.203.53@tcp:104: 00010000:00010000:1.0:1785787841.335651:0:14937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2a2c889/0xe2c2ff68a6e85b6f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd879 expref: 8 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.335678:0:14937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9190443c5e00, rc 0) 00000100:00100000:1.0:1785787841.335752:0:14937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bc19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aabe278a-8cfd-4235-9dd3-056b28921491+8:14558:x1872533744911360:12345-192.168.203.53@tcp:101:lhsmtool_posix.0 Request processed in 5819us (6051us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787841.335763:0:14937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 17 00000100:00100000:3.0:1785787841.367760:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787841.367925:0:14287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744911488 00000100:00100000:0.0:1785787841.367938:0:14287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744911488 00010000:00010000:0.0:1785787841.367989:0:14287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e7c237a0/0xe2c2ff68a6e85b61 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd872 expref: 8 pid: 14938 timeout: 728 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787841.368040:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 14 00000100:00100000:0.0:1785787841.368051:0:14287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aabe278a-8cfd-4235-9dd3-056b28921491+8:2390:x1872533744911488:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785787841.368069:0:14287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785787841.368097:0:14287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e7c237a0/0xe2c2ff68a6e85b61 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd872 expref: 8 pid: 14938 timeout: 728 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787841.368113:0:14287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e7c237a0/0xe2c2ff68a6e85b61 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd872 expref: 8 pid: 14938 timeout: 728 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787841.368139:0:14287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7c237a0/0xe2c2ff68a6e85b61 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd872 expref: 8 pid: 14938 timeout: 728 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787841.368160:0:14287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785787841.368176:0:14287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785787841.368184:0:14287:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2a2c889/0xe2c2ff68a6e85b6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd879 expref: 7 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787841.368213:0:14287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a2c889/0xe2c2ff68a6e85b6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd879 expref: 7 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787841.368278:0:14287:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c2a2c889/0xe2c2ff68a6e85b6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd879 expref: 7 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787841.368295:0:14287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b48d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14287:1872533770066560:192.168.203.53@tcp:105: 00000100:00100000:0.0:1785787841.368411:0:14287:0:(client.c:2702:ptlrpc_set_wait()) set ffff91907bdc2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1785787841.377557:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787841.377660:0:14939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744911616 00000100:00100000:2.0:1785787841.377673:0:14939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744911616 00000100:00100000:2.0:1785787841.377751:0:14939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 18 00000100:00100000:2.0:1785787841.377762:0:14939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aabe278a-8cfd-4235-9dd3-056b28921491+8:2390:x1872533744911616:12345-192.168.203.53@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1785787841.378058:0:14939:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1785787841.378062:0:14939:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1785787840 00002000:00010000:2.0:1785787841.378065:0:14939:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1785787838 00002000:00010000:2.0:1785787841.378068:0:14939:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1785787841 -> 1785787840 00002000:00010000:2.0:1785787841.378070:0:14939:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1785787841.378137:0:14939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aabe278a-8cfd-4235-9dd3-056b28921491+9:2390:x1872533744911616:12345-192.168.203.53@tcp:2:lhsmtool_posix.0 Request processed in 377us (593us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1785787841.378147:0:14939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 18 00000100:00100000:0.0:1785787841.378572:0:14287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b48d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14287:1872533770066560:192.168.203.53@tcp:105: 00010000:00010000:0.0:1785787841.378599:0:14287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785787841.378625:0:14287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aabe278a-8cfd-4235-9dd3-056b28921491+8:2390:x1872533744911488:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 10576us (10881us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787841.378634:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 14 00000100:00100000:2.0:1785787841.396085:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1785787841.397115:0:14937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744911744 00000100:00100000:1.0:1785787841.397129:0:14937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744911744 00000100:00100000:1.0:1785787841.397226:0:14937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 19 00000100:00100000:1.0:1785787841.397993:0:14937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bc19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aabe278a-8cfd-4235-9dd3-056b28921491+8:2391:x1872533744911744:12345-192.168.203.53@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1785787841.398054:0:14937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004fc1341e/0xe2c2ff68a6e85b76 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.398079:0:14937:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2a2c889/0xe2c2ff68a6e85b6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd879 expref: 8 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.398460:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785787841.398467:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1785787841.398472:0:14937:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fc1341e/0xe2c2ff68a6e85b76 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.398519:0:14937:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c2a2c889/0xe2c2ff68a6e85b6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd879 expref: 8 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785787841.398535:0:14937:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c2a2c889/0xe2c2ff68a6e85b6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd879 expref: 8 pid: 14937 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787841.398553:0:14937:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b6cad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:14937:1872533770066688:192.168.203.53@tcp:104: 00000100:00100000:1.0:1785787841.398657:0:14937:0:(client.c:2702:ptlrpc_set_wait()) set ffff919046e0fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1785787841.408381:0:14937:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b6cad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:14937:1872533770066688:192.168.203.53@tcp:104: 00010000:00010000:2.0:1785787841.408417:0:14937:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004fc1341e/0xe2c2ff68a6e85b76 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787841.408593:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787841.408815:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744911872 00000100:00100000:3.0:1785787841.408824:0:14286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744911872 00010000:00010000:3.0:1785787841.409091:0:14286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a2c889/0xe2c2ff68a6e85b6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd879 expref: 9 pid: 14937 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787841.409255:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 15 00000100:00100000:2.0:1785787841.409268:0:14286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b6c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aabe278a-8cfd-4235-9dd3-056b28921491+9:2391:x1872533744911872:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785787841.409285:0:14286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785787841.409312:0:14286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c2a2c889/0xe2c2ff68a6e85b6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd879 expref: 9 pid: 14937 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.409328:0:14286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c2a2c889/0xe2c2ff68a6e85b6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd879 expref: 9 pid: 14937 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.409366:0:14286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2a2c889/0xe2c2ff68a6e85b6f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd879 expref: 9 pid: 14937 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.409387:0:14286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785787841.409392:0:14286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785787841.409399:0:14286:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004fc1341e/0xe2c2ff68a6e85b76 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.409409:0:14286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fc1341e/0xe2c2ff68a6e85b76 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.409447:0:14286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785787841.409516:0:14286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b6c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aabe278a-8cfd-4235-9dd3-056b28921491+8:2391:x1872533744911872:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 250us (1298us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787841.409525:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 15 00010000:00010000:3.0:1785787841.410636:0:14937:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004fc1341e/0xe2c2ff68a6e85b76 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.410648:0:14937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fc1341e/0xe2c2ff68a6e85b76 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.410689:0:14937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004fc1341e/0xe2c2ff68a6e85b76 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.410698:0:14937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004fc1341e/0xe2c2ff68a6e85b76 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.410707:0:14937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004fc1341e/0xe2c2ff68a6e85b76 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.410715:0:14937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9190443c5400 already unused, calling callback (ffffffffc174c300) 00010000:00010000:3.0:1785787841.410720:0:14937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004fc1341e/0xe2c2ff68a6e85b76 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.410730:0:14937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004fc1341e/0xe2c2ff68a6e85b76 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.410743:0:14937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004fc1341e/0xe2c2ff68a6e85b76 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.410751:0:14937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fc1341e/0xe2c2ff68a6e85b76 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787841.410821:0:14937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bc19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aabe278a-8cfd-4235-9dd3-056b28921491+7:2391:x1872533744911744:12345-192.168.203.53@tcp:1:lhsmtool_posix.0 Request processed in 13586us (14750us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787841.410968:0:14937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 19 00000100:00100000:1.0:1785787841.417905:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787841.418067:0:15621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744912128 00000100:00100000:2.0:1785787841.418080:0:15621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744912128 00000100:00100000:2.0:1785787841.418158:0:15621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 60 00000100:00100000:2.0:1785787841.418170:0:15621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b6caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aabe278a-8cfd-4235-9dd3-056b28921491+13:14558:x1872533744912128:12345-192.168.203.53@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1785787841.418296:0:15621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e85b7d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.418318:0:15621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e85b7d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.418332:0:15621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e85b7d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.418660:0:15621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85b84 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.418674:0:15621:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4c00/0xe2c2ff68a6e85b4c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd864 expref: 14 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.418683:0:15621:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85b84 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.418723:0:15621:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4c00/0xe2c2ff68a6e85b4c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd864 expref: 14 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.418739:0:15621:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4c00/0xe2c2ff68a6e85b4c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd864 expref: 14 pid: 14303 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787841.418755:0:15621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bc18000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15621:1872533770066816:192.168.203.53@tcp:104: 00000100:00100000:2.0:1785787841.418876:0:15621:0:(client.c:2702:ptlrpc_set_wait()) set ffff9190507ea3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785787841.422200:0:15621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bc18000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15621:1872533770066816:192.168.203.53@tcp:104: 00010000:00010000:0.0:1785787841.422249:0:15621:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85b84 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785787841.424922:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787841.425814:0:14287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744912256 00000100:00100000:0.0:1785787841.425850:0:14287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744912256 00010000:00010000:0.0:1785787841.426005:0:14287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4c00/0xe2c2ff68a6e85b4c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd864 expref: 15 pid: 14303 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785787841.426053:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 16 00000100:00100000:0.0:1785787841.426065:0:14287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b6c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aabe278a-8cfd-4235-9dd3-056b28921491+15:2391:x1872533744912256:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785787841.426110:0:14287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785787841.426119:0:14287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4c00/0xe2c2ff68a6e85b4c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd864 expref: 15 pid: 14303 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787841.426135:0:14287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4c00/0xe2c2ff68a6e85b4c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd864 expref: 15 pid: 14303 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787841.426174:0:14287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9190443c4c00/0xe2c2ff68a6e85b4c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd864 expref: 15 pid: 14303 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787841.426193:0:14287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9190557cba00) 00010000:00010000:0.0:1785787841.426199:0:14287:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85b84 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787841.426210:0:14287:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85b84 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787841.426227:0:14287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85b84 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785787841.426495:0:14287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785787841.426565:0:14287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b6c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aabe278a-8cfd-4235-9dd3-056b28921491+14:2391:x1872533744912256:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 502us (1669us total) trans 0 rc 0/0 00000100:00100000:0.0:1785787841.426574:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 16 00010000:00010000:2.0:1785787841.426691:0:15621:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85b84 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.426702:0:15621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85b84 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785787841.427065:0:15621:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:2.0:1785787841.428476:0:15621:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:2.0:1785787841.428529:0:15621:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:2.0:1785787841.428657:0:15621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bc18e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15621:1872533770066944:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1785787841.430693:0:15621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787841.430741:0:15621:0:(client.c:2702:ptlrpc_set_wait()) set ffff918f42eee900 going to sleep for 11 seconds 00000100:00100000:1.0:1785787841.431213:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770066944 00000100:00100000:1.0:1785787841.431222:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770066944 00000100:00100000:1.0:1785787841.431282:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1785787841.431290:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bc19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15621:x1872533770066944:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1785787841.431404:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bc19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15621:x1872533770066944:12345-0@lo:1000:mdt00_003.0 Request processed in 114us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787841.431411:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1785787841.446722:0:15621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bc18e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15621:1872533770066944:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1785787841.452875:0:15621:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:1.0:1785787841.452957:0:15621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907b6cad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15621:1872533770067072:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1785787841.453018:0:15621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787841.453055:0:15621:0:(client.c:2702:ptlrpc_set_wait()) set ffff919046e0f180 going to sleep for 11 seconds 00000100:00100000:2.0:1785787841.456624:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770067072 00000100:00100000:2.0:1785787841.456637:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770067072 00000100:00100000:2.0:1785787841.456700:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1785787841.456710:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15621:x1872533770067072:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1785787841.456988:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:15621:x1872533770067072:12345-0@lo:1000:mdt00_003.0 Request processed in 279us (3968us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1785787841.456996:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1785787841.457396:0:15621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907b6cad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15621:1872533770067072:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1785787841.457435:0:15621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85b84 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.457448:0:15621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85b84 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.457456:0:15621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85b84 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.457462:0:15621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677ce00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787841.457466:0:15621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85b84 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.457474:0:15621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85b84 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.457489:0:15621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9190557cba00) 00010000:00010000:3.0:1785787841.457492:0:15621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785787841.457496:0:15621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85b84 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.457502:0:15621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85b84 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.457528:0:15621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f600/0xe2c2ff68a6e85adc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.457535:0:15621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f600/0xe2c2ff68a6e85adc lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.457552:0:15621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f600/0xe2c2ff68a6e85adc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.457558:0:15621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919052f5f600 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787841.457561:0:15621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f600/0xe2c2ff68a6e85adc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.457567:0:15621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f600/0xe2c2ff68a6e85adc lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.457574:0:15621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919059e3e600) 00010000:00010000:3.0:1785787841.457576:0:15621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785787841.457583:0:15621:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e85ae3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd848 expref: 17 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.457594:0:15621:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e85ae3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd848 expref: 17 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.457613:0:15621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e85ae3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd848 expref: 17 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.457645:0:15621:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5e400/0xe2c2ff68a6e85ae3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd848 expref: 17 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787841.457658:0:15621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91905faf4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15621:1872533770067200:192.168.203.53@tcp:105: 00000100:00100000:3.0:1785787841.457733:0:15621:0:(client.c:2702:ptlrpc_set_wait()) set ffff919050e636c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785787841.464466:0:15621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91905faf4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15621:1872533770067200:192.168.203.53@tcp:105: 00010000:00010000:3.0:1785787841.464521:0:15621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f600/0xe2c2ff68a6e85adc lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.464534:0:15621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919052f5f600/0xe2c2ff68a6e85adc lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.464575:0:15621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902000/0xe2c2ff68a6e85b8b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.464591:0:15621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902000/0xe2c2ff68a6e85b8b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.464605:0:15621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902000/0xe2c2ff68a6e85b8b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.464617:0:15621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902000/0xe2c2ff68a6e85b8b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.464624:0:15621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902000/0xe2c2ff68a6e85b8b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.464631:0:15621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902000/0xe2c2ff68a6e85b8b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.464638:0:15621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f902000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787841.464643:0:15621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902000/0xe2c2ff68a6e85b8b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.464651:0:15621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902000/0xe2c2ff68a6e85b8b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.464663:0:15621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919059e3e600) 00010000:00010000:3.0:1785787841.464672:0:15621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785787841.464678:0:15621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902000/0xe2c2ff68a6e85b8b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.464684:0:15621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f902000/0xe2c2ff68a6e85b8b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.464695:0:15621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e85b7d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.464701:0:15621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e85b7d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.464707:0:15621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e85b7d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.464712:0:15621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677d000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:3.0:1785787841.464715:0:15621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e85b7d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.464721:0:15621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e85b7d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.464730:0:15621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919059e3e600) 00010000:00010000:3.0:1785787841.464733:0:15621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1785787841.464736:0:15621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e85b7d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.464742:0:15621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e85b7d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785787841.465307:0:15621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b6caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aabe278a-8cfd-4235-9dd3-056b28921491+17:14558:x1872533744912128:12345-192.168.203.53@tcp:57:lhsmtool_posix.0 Request processed in 47137us (47414us total) trans 8589934628 rc 0/0 00000100:00100000:3.0:1785787841.465328:0:15621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 60 00000020:00080000:3.0:1785787841.465335:0:15621:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1785787841.467781:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787841.469595:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744912384 00000100:00100000:3.0:1785787841.469611:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744912384 00000100:00100000:3.0:1785787841.469672:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 12 00000100:00100000:3.0:1785787841.469681:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aabe278a-8cfd-4235-9dd3-056b28921491+17:14557:x1872533744912384:12345-192.168.203.53@tcp:49:bash.0 00000100:00100000:3.0:1785787841.469863:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aabe278a-8cfd-4235-9dd3-056b28921491+17:14557:x1872533744912384:12345-192.168.203.53@tcp:49:bash.0 Request processed in 181us (2092us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787841.469872:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 12 00000100:00100000:1.0:1785787841.472421:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787841.474868:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744912640 00000100:00100000:3.0:1785787841.474884:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744912640 00000100:00100000:3.0:1785787841.474964:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 13 00000100:00100000:3.0:1785787841.474975:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aabe278a-8cfd-4235-9dd3-056b28921491+17:14558:x1872533744912640:12345-192.168.203.53@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1785787841.477997:0:14305:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1785787841.478134:0:14305:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:3.0:1785787841.478223:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e85b92 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785787841.478464:0:14333:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1785787841.478470:0:14333:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1785787841.478505:0:14333:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1785787841.478511:0:14333:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1785787841.478890:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e85b92 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.478917:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e85b92 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.478930:0:14305:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e85b92 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.478937:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e85b92 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.478952:0:14305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e85b92 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.478977:0:14305:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785787841.479647:0:15809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785787841.479655:0:15809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e85b92 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.479663:0:15809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91905f903000 already unused, calling callback (ffffffffc174c300) 00010000:00010000:2.0:1785787841.479667:0:15809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e85b92 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.479689:0:15809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e85b92 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.479704:0:15809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9190557cba00) 00010000:00010000:2.0:1785787841.479707:0:15809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1785787841.479712:0:15809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e85b92 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.479718:0:15809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91905f903000/0xe2c2ff68a6e85b92 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.479731:0:15809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787841.479733:0:15809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787841.479735:0:15809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785787841.483424:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aabe278a-8cfd-4235-9dd3-056b28921491+19:14558:x1872533744912640:12345-192.168.203.53@tcp:35:lhsmtool_posix.0 Request processed in 8433us (10994us total) trans 8589934630 rc 0/0 00000100:00100000:3.0:1785787841.483444:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 13 00000020:00080000:3.0:1785787841.483455:0:14305:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785787841.484264:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787841.484788:0:14938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744912768 00000100:00100000:3.0:1785787841.484802:0:14938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744912768 00000100:00100000:3.0:1785787841.484918:0:14938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 20 00000100:00100000:3.0:1785787841.484930:0:14938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aabe278a-8cfd-4235-9dd3-056b28921491+7:14557:x1872533744912768:12345-192.168.203.53@tcp:101:bash.0 00010000:00010000:3.0:1785787841.484951:0:14938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785787841.484977:0:14938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cdea084/0xe2c2ff68a6e85b99 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd880 expref: -99 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785787841.485011:0:14938:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a70f5c0, atime: 0x6a70f5be, ctime: 0x6a70f5c0, blocks: 0x1 00010000:00010000:3.0:1785787841.485038:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=628s v=(0 0) 00010000:00010000:3.0:1785787841.485043:0:14938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785787841.485055:0:14938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cdea084/0xe2c2ff68a6e85b99 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd880 expref: 8 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.485074:0:14938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007cdea084/0xe2c2ff68a6e85b99 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd880 expref: 8 pid: 14938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785787841.485088:0:14938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91905f902000, rc 0) 00000100:00100000:3.0:1785787841.485419:0:14938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aabe278a-8cfd-4235-9dd3-056b28921491+8:14557:x1872533744912768:12345-192.168.203.53@tcp:101:bash.0 Request processed in 491us (1161us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787841.485427:0:14938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 20 00000100:00100000:1.0:1785787841.490694:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1785787841.490774:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744913024 00000100:00100000:0.0:1785787841.490787:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744913024 00000100:00100000:0.0:1785787841.491082:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 14 00000100:00100000:0.0:1785787841.491105:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aabe278a-8cfd-4235-9dd3-056b28921491+19:14557:x1872533744913024:12345-192.168.203.53@tcp:35:bash.0 00000001:00080000:0.0:1785787841.491567:0:14304:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:0.0:1785787841.491690:0:14304:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:0.0:1785787841.491821:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aabe278a-8cfd-4235-9dd3-056b28921491+22:14557:x1872533744913024:12345-192.168.203.53@tcp:35:bash.0 Request processed in 728us (1138us total) trans 8589934633 rc 0/0 00000100:00100000:0.0:1785787841.493473:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 14 00000020:00080000:0.0:1785787841.493481:0:14304:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1785787841.526123:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785787841.617929:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787841.618081:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744913280 00000100:00100000:2.0:1785787841.618103:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744913280 00000100:00100000:2.0:1785787841.618183:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 61 00000100:00100000:2.0:1785787841.618194:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aabe278a-8cfd-4235-9dd3-056b28921491+22:14568:x1872533744913280:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:2.0:1785787841.618232:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785787841.618265:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e85ba0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbd43e1ec25dd887 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785787841.618586:0:14301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1785787841.618773:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e85ba0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd887 expref: 24 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.618790:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff919047f90a00) 00010000:00010000:2.0:1785787841.618794:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785787841.618807:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e85ba0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xbd43e1ec25dd887 expref: 24 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.618822:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91904677d000, rc 0) 00000100:00100000:2.0:1785787841.618957:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aabe278a-8cfd-4235-9dd3-056b28921491+23:14568:x1872533744913280:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 765us (1057us total) trans 8589934634 rc 301/301 00000100:00100000:2.0:1785787841.618966:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 61 00000100:00100000:1.0:1785787841.623702:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1785787841.623784:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744913408 00000100:00100000:2.0:1785787841.623797:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744913408 00000100:00100000:2.0:1785787841.623890:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 62 00000100:00100000:2.0:1785787841.623915:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aabe278a-8cfd-4235-9dd3-056b28921491+23:14568:x1872533744913408:12345-192.168.203.53@tcp:34:lfs.0 00010000:00010000:2.0:1785787841.624005:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e85bae lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.624025:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e85bae lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.624040:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e85bae lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.624057:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85bb5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.624064:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.624071:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.624505:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85bbc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.624522:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85bbc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.624530:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85bbc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785787841.624590:0:14303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85bbc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.624605:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e85bae lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.624613:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e85bae lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.624621:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e85bae lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.624627:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677d000 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787841.624631:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e85bae lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.624639:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e85bae lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.624652:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff919047f90900) 00010000:00010000:2.0:1785787841.624655:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787841.624659:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e85bae lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.624666:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677d000/0xe2c2ff68a6e85bae lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.624688:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.624695:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85bb5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.624700:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85bb5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.624705:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677cc00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787841.624708:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85bb5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.624713:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85bb5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.624721:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff919047f90500) 00010000:00010000:2.0:1785787841.624724:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787841.624728:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85bb5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.624734:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677cc00/0xe2c2ff68a6e85bb5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.624751:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85bbc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.624756:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85bbc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.624763:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85bbc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.624776:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91904677ce00 already unused, calling callback (ffffffffc218b4f0) 00010000:00010000:2.0:1785787841.624780:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85bbc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.624786:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85bbc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.624794:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff919059e3e600) 00010000:00010000:2.0:1785787841.624796:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785787841.624799:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85bbc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785787841.624805:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91904677ce00/0xe2c2ff68a6e85bbc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785787841.626117:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aabe278a-8cfd-4235-9dd3-056b28921491+23:14568:x1872533744913408:12345-192.168.203.53@tcp:34:lfs.0 Request processed in 2213us (2422us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787841.626129:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 62 00000100:00100000:0.0:1785787841.630561:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787841.630715:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744913664 00000100:00100000:3.0:1785787841.630728:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744913664 00000100:00100000:3.0:1785787841.630788:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 15 00000100:00100000:3.0:1785787841.630799:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907b48ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aabe278a-8cfd-4235-9dd3-056b28921491+23:14568:x1872533744913664:12345-192.168.203.53@tcp:35:lfs.0 00000100:00100000:3.0:1785787841.631558:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907b48ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aabe278a-8cfd-4235-9dd3-056b28921491+24:14568:x1872533744913664:12345-192.168.203.53@tcp:35:lfs.0 Request processed in 758us (1004us total) trans 8589934635 rc 0/0 00000100:00100000:3.0:1785787841.631565:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 15 00010000:00010000:2.0:1785787842.547039:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785787843.572469:0:15809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785787844.021841:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bc1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770067456:0@lo:400:kworker.0 00000100:00100000:2.0:1785787844.021923:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787844.021983:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bc1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3336:1872533770067968:0@lo:400:kworker.0 00000100:00100000:2.0:1785787844.022006:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787844.022031:0:3336:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1785787844.022036:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bc1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9a1da20-2955-44fa-b075-f73628199db8:3336:1872533770067328:0@lo:400:kworker.0 00000100:00100000:2.0:1785787844.022060:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787844.022081:0:3336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bc1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3336:1872533770067840:0@lo:400:kworker.0 00000100:00100000:2.0:1785787844.022110:0:3336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787844.022132:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bc19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770067584:0@lo:400:kworker.0 00000100:00100000:2.0:1785787844.022153:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787844.022168:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785787844.022173:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91907bc1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1872533770067712:0@lo:400:kworker.0 00000100:00100000:2.0:1785787844.022191:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785787844.022502:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770067968 00000100:00100000:2.0:1785787844.022510:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770067968 00000100:00100000:2.0:1785787844.022561:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770067840 00000100:00100000:2.0:1785787844.022564:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770067840 00000100:00100000:2.0:1785787844.022575:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770067712 00000100:00100000:2.0:1785787844.022577:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770067712 00000100:00100000:2.0:1785787844.022593:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1785787844.022601:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bc18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3336:x1872533770067968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787844.022655:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bc18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3336:x1872533770067968:12345-0@lo:400:kworker.0 Request processed in 54us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787844.022662:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1785787844.022681:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1785787844.022686:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bc1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3336:x1872533770067840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787844.022709:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bc1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3336:x1872533770067840:12345-0@lo:400:kworker.0 Request processed in 23us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787844.022714:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1785787844.022723:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1785787844.022729:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bc19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1872533770067712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785787844.022752:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bc19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1872533770067712:12345-0@lo:400:kworker.0 Request processed in 24us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787844.022757:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1785787844.022785:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785787844.022820:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bc1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3333:1872533770067712:0@lo:400:kworker.0 00000100:00100000:2.0:1785787844.022867:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bc1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3336:1872533770067840:0@lo:400:kworker.0 00000100:00100000:2.0:1785787844.022875:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bc1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3336:1872533770067968:0@lo:400:kworker.0 00000100:00100000:1.0:1785787844.024241:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770067328 00000100:00100000:1.0:1785787844.024247:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770067328 00000100:00100000:1.0:1785787844.024285:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1785787844.024292:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+19:3336:x1872533770067328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785787844.024359:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9a1da20-2955-44fa-b075-f73628199db8+19:3336:x1872533770067328:12345-0@lo:400:kworker.0 Request processed in 67us (2297us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787844.024366:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1785787844.024413:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bc1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9a1da20-2955-44fa-b075-f73628199db8:3336:1872533770067328:0@lo:400:kworker.0 00000100:00100000:2.0:1785787844.028990:0:3333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770068096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785787844.029086:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785787844.029543:0:14937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770067456 00000100:00100000:3.0:1785787844.029553:0:14937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770067456 00000100:00100000:3.0:1785787844.029616:0:14937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770067584 00000100:00100000:3.0:1785787844.029619:0:14937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770067584 00000100:00100000:3.0:1785787844.029637:0:14937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1785787844.029648:0:14937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bc1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770067456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787844.029711:0:14937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bc1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3336:x1872533770067456:12345-0@lo:400:kworker.0 Request processed in 65us (7787us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787844.029718:0:14937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1785787844.029733:0:14937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1785787844.029739:0:14937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bc18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3333:x1872533770067584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785787844.029768:0:14937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bc18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3333:x1872533770067584:12345-0@lo:400:kworker.0 Request processed in 29us (7614us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787844.029773:0:14937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1785787844.029797:0:16007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770068096 00000100:00100000:3.0:1785787844.029801:0:16007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770068096 00000100:00100000:3.0:1785787844.029854:0:16007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1785787844.029860:0:16007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bc1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770068096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785787844.029889:0:16007:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785787844.029919:0:16007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bc1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1872533770068096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787844.029926:0:16007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1785787844.029940:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785787844.029944:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785787844.029976:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770068096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785787844.029989:0:3333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bc19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3333:1872533770067584:0@lo:400:kworker.0 00000100:00100000:1.0:1785787844.031603:0:3336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91907bc1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3336:1872533770067456:0@lo:400:kworker.0 00000100:00100000:1.0:1785787844.031661:0:3334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff919077a9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770068224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785787844.031704:0:3334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785787844.031750:0:14941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533770068224 00000100:00100000:1.0:1785787844.031755:0:14941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533770068224 00000100:00100000:1.0:1785787844.031785:0:14941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1785787844.031791:0:14941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff919077a98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3334:x1872533770068224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785787844.031815:0:14941:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785787844.031871:0:14941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff919077a98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3334:x1872533770068224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1785787844.031879:0:14941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1785787844.031908:0:3334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff919077a9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3334:1872533770068224:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1785787844.082303:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:0.0:1785787844.082323:0:7522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:02000400:2.0:1785787844.084540:0:16479:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:3.0:1785787844.230592:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787844.230638:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787844.230670:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787844.230688:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787844.230708:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787844.230739:0:14938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744914048 00000100:00100000:3.0:1785787844.230750:0:14938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744914048 00000100:00100000:3.0:1785787844.230815:0:14938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744914432 00000100:00100000:3.0:1785787844.230818:0:14938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744914432 00000100:00100000:3.0:1785787844.230861:0:14938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 22 00000100:00100000:3.0:1785787844.230871:0:14938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aabe278a-8cfd-4235-9dd3-056b28921491+6:2389:x1872533744914432:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1785787844.230963:0:14938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aabe278a-8cfd-4235-9dd3-056b28921491+6:2389:x1872533744914432:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 93us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787844.230971:0:14938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 22 00000100:00100000:3.0:1785787844.230988:0:14938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 21 00000100:00100000:3.0:1785787844.230994:0:14938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aabe278a-8cfd-4235-9dd3-056b28921491+5:2387:x1872533744914048:12345-192.168.203.53@tcp:9:kworker.0 00000020:00000080:3.0:1785787844.231021:0:14938:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2c2ff68a6e8584a 00000100:00080000:3.0:1785787844.231038:0:14938:0:(import.c:65:import_set_state_nolock()) ffff919077aa8000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1785787844.231081:0:14938:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:3.0:1785787844.231380:0:14938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aabe278a-8cfd-4235-9dd3-056b28921491+2:2387:x1872533744914048:12345-192.168.203.53@tcp:9:kworker.0 Request processed in 385us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787844.231387:0:14938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 21 00000100:00080000:3.0:1785787844.231405:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785787844.231410:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1785787844.231548:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785787844.231878:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744913920 00000100:00100000:2.0:1785787844.231892:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744913920 00000100:00100000:2.0:1785787844.231933:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744914560 00000100:00100000:2.0:1785787844.231936:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744914560 00000100:00100000:2.0:1785787844.231956:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 37 00000100:00100000:2.0:1785787844.231963:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905faf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aabe278a-8cfd-4235-9dd3-056b28921491+24:2389:x1872533744913920:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:2.0:1785787844.232006:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905faf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aabe278a-8cfd-4235-9dd3-056b28921491+24:2389:x1872533744913920:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 43us (1367us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787844.232013:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 37 00000100:00100000:2.0:1785787844.232030:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 38 00000100:00100000:2.0:1785787844.232035:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+6:2389:x1872533744914560:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:2.0:1785787844.232058:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+6:2389:x1872533744914560:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 22us (1369us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787844.232064:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 38 00000100:00100000:2.0:1785787844.232083:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744913792 00000100:00100000:2.0:1785787844.232087:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744913792 00000100:00100000:2.0:1785787844.232112:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 126 00000100:00100000:2.0:1785787844.232117:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91905fafbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+13:2389:x1872533744913792:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:2.0:1785787844.232151:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91905fafbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6d0cc6bb-46e4-48f9-b637-88656ab6ce94+13:2389:x1872533744913792:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 34us (1481us total) trans 0 rc 0/0 00000100:00100000:2.0:1785787844.232169:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 126 00000100:00080000:3.0:1785787844.232782:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785787844.238137:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787844.238328:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787844.238371:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787844.238403:0:14939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744914304 00000100:00100000:3.0:1785787844.238414:0:14939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744914304 00000100:00100000:3.0:1785787844.238468:0:14939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744914688 00000100:00100000:3.0:1785787844.238470:0:14939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744914688 00000100:00100000:3.0:1785787844.238494:0:14939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 22 00000100:00100000:3.0:1785787844.238503:0:14939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907d628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aabe278a-8cfd-4235-9dd3-056b28921491+6:2390:x1872533744914304:12345-192.168.203.53@tcp:16:kworker.0 00000100:00100000:3.0:1785787844.238640:0:14939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907d628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aabe278a-8cfd-4235-9dd3-056b28921491+6:2390:x1872533744914304:12345-192.168.203.53@tcp:16:kworker.0 Request processed in 138us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787844.238648:0:14939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 22 00000100:00100000:3.0:1785787844.238797:0:14939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 23 00000100:00100000:3.0:1785787844.238802:0:14939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+5:2387:x1872533744914688:12345-192.168.203.53@tcp:9:kworker.0 00000020:00000080:3.0:1785787844.238849:0:14939:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2c2ff68a6e85882 00000100:00080000:3.0:1785787844.238858:0:14939:0:(import.c:65:import_set_state_nolock()) ffff91907733d800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1785787844.238967:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1785787844.239025:0:14939:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:3.0:1785787844.239295:0:14939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+2:2387:x1872533744914688:12345-192.168.203.53@tcp:9:kworker.0 Request processed in 492us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787844.239303:0:14939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 23 00000100:00080000:3.0:1785787844.239358:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785787844.239690:0:14942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744914176 00000100:00100000:0.0:1785787844.239696:0:14942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744914176 00002000:00100000:0.0:1785787844.239727:0:14942:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff91907bb35500 x1872533744914176/t0(0) o4->aabe278a-8cfd-4235-9dd3-056b28921491@192.168.203.53@tcp:700/0 lens 504/0 e 0 to 0 dl 1785787855 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1785787844.239739:0:14942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91907bb35500 with x1872533744914176 ext(0->8) 00002000:00010000:0.0:1785787844.239746:0:14942:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91907bb35500 00000100:00100000:0.0:1785787844.239773:0:14942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 0 00000100:00100000:0.0:1785787844.239780:0:14942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bb35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aabe278a-8cfd-4235-9dd3-056b28921491+6:2390:x1872533744914176:12345-192.168.203.53@tcp:4:bash.0 00000100:00100000:0.0:1785787844.240263:0:14942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bb35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aabe278a-8cfd-4235-9dd3-056b28921491+8:2390:x1872533744914176:12345-192.168.203.53@tcp:4:bash.0 Request processed in 481us (2137us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1785787844.240271:0:14942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 0 00002000:00100000:0.0:1785787844.240277:0:14942:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff91907bb35500 x1872533744914176/t8589934598(0) o4->aabe278a-8cfd-4235-9dd3-056b28921491@192.168.203.53@tcp:700/0 lens 504/448 e 0 to 0 dl 1785787855 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1785787844.240286:0:14942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91907bb35500 with x1872533744914176 ext(0->8) 00002000:00010000:0.0:1785787844.240289:0:14942:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91907bb35500 00000100:00100000:2.0:1785787844.257117:0:3328:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1785787844.257257:0:14938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872533744914816 00000100:00100000:3.0:1785787844.257270:0:14938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872533744914816 00000100:00100000:3.0:1785787844.257368:0:14938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 24 00000100:00100000:3.0:1785787844.257379:0:14938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91907bc1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+5:2387:x1872533744914816:12345-192.168.203.53@tcp:9:kworker.0 00000020:00000080:3.0:1785787844.257414:0:14938:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe2c2ff68a6e85889 00000100:00080000:3.0:1785787844.257433:0:14938:0:(import.c:65:import_set_state_nolock()) ffff91907733b000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1785787844.257477:0:14938:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934598 00000100:00100000:3.0:1785787844.257739:0:14938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91907bc1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8da83796-a8e7-420f-9cfe-c8b5aabd12f4+2:2387:x1872533744914816:12345-192.168.203.53@tcp:9:kworker.0 Request processed in 361us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1785787844.257748:0:14938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 24 00000100:00080000:0.0:1785787844.258300:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1785787844.258353:0:15809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1785787844.532063:0:14333:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1785787844.532072:0:14333:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1785787844.532109:0:14333:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1785787844.532115:0:14333:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1785787844.595350:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1785787845.114147:0:6642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8da83796-a8e7-420f-9cfe-c8b5aabd12f4 00000020:00000080:2.0:1785787845.114156:0:6642:0:(genops.c:906:class_export_put()) final put ffff91907733f000/8da83796-a8e7-420f-9cfe-c8b5aabd12f4 00000001:00100000:2.0:1785787845.114177:0:6642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aabe278a-8cfd-4235-9dd3-056b28921491 00000020:00000080:2.0:1785787845.114180:0:6642:0:(genops.c:906:class_export_put()) final put ffff919077aaf800/aabe278a-8cfd-4235-9dd3-056b28921491 00000020:00000080:1.0:1785787845.114283:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff91907733f000/8da83796-a8e7-420f-9cfe-c8b5aabd12f4 for lustre-OST0000 00000020:00000080:1.0:1785787845.114321:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff919077aaf800/aabe278a-8cfd-4235-9dd3-056b28921491 for lustre-OST0000 00000020:00000080:1.0:1785787845.114344:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91907733d800 for lustre-OST0000 00000020:00000080:1.0:1785787845.114349:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff919077aa8000 for lustre-OST0000 00010000:00010000:2.0:1785787845.619026:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 31151 lines, 31151 kept, 0 dropped, 0 bad.